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STATEMENT OF FOCUS 



The Wisconsin Research and Development Center for Cognitive 
Learning focuses on contributing to a better understanding of cogni- 
tive learning by children and youth and to the improvement of re- 
lated educational practices. The strategy for research and develop- 
ment is comprehensive. It includes basic research to generate new 
knowledge about the conditions and processes of learning and about 
the processes of instruction, and the subsequent development of 
research-based instructional materials, many of which are designed 
for use by teachers and others for use by students. These materials 
are tested and refined in school settings. Throughout these opera- 
tions behavioral scientists, curriculum experts, academic scholars, 
and school people interact, insuring that the results of Center 
activities are based soundly on knowledge of subject matter and 
cognitive learning and that they are applied to the improvement 
of educational practice. 

This Technical Report is from Phase 2 of the Project on Proto- 
typic Instructional Systems in Elementary Mathematics in Program 2. 
General objectives of the Program are to establish rationale and 
strategy for developing instructional systems, to identify sequences 
of concepts and cognitive skills , to develop assessment procedures 
for those concepts and skills, to identify or develop instructional 
materials associated with the concepts and cognitive skills, and to 
generate new knowledge about instructional procedures. Contributing 
to the Program objectives, the Mathematics Project, Phase 1, is 
developing and testing a televised course in arithmetic for Grades 
1-6 which provides not only a complete program of instruction for 
the pupils but also inservice training for teachers. Phase 2 has 
a long-term goal of providing an individually guided instructional 
program in elementary mathematics . Preliminary activities include 
identifying instructional objectives, student activities, teacher 
activities materials , and assessment procedures for integration into 
a total mathematics curriculum. The third phase focuses on the 
development of a computer system for managing individually guided 
instruction in mathematics and on a later extension of the system’s 
applicability. 
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ABSTRACT 



Purpose 

The study had one major goal: To determine whether the technique 

of "item- sampling” could be incorporated into a design effective for 
formative curriculum evaluation. The study evaluated only grade 6 
of a television arithmetic program. Patterns In Arithmetic (PIA) . 

Other goals of the study were (1) To explore the practical relation- 
ship between the population and item parameters (2) To discuss ways 
formative curriculum evaluation can be used and (3) To suggest 
advantages item- sampling has over traditional achievement testing. 
Procedure 

A large pool of items was assembled that represented objectives 

to be covered by PIA-6. The items were selected while the program 

was in the planning stage. Approximately 60 classes near Madison, 

Wisconsin, and using PIA-6 participated in the study. Twelve, 20- item 

tests were constructed from the item pool. These tests were administered 

at four times during the year to a fandom sample of students. At each 

administration one gets a measure of the difficulty of all 12 x 20 = 

240 items. These measures provide a profile of change across the 

school year. Changes in performance on a given item were evaluated 

in terms of expected behaviors following instruction. When observed 

behavior was at a level below that of expected behavior, revisions 

Were suggested. Criterion referencing of items was used to indicate 
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expected behaviors. Testing done early in the school year was used 
for planning programs that were written and taped later in the year. 
Results 

Several important changes were made in PIA-6 as a result of the 
formative evaluation. It was found that 120-130 random responses to 
an item were sufficient to yield an estimate of item difficulty that 
was useful for making developmental year decisions. It became clear 
that the success of a curriculum study using item-sampling depends 
largely upon the quality of the hand-picked items that constitute 
the item pool. Much of the planning should be devoted to selecting 
items that are sensitive to the behavioral objectives of the curric- 
ulum. The role of the evaluator became clearly defined. He must be 
an active part of the developmental project and have more than a 
passing knowledge of the curriculum and its objectives. Criterion 
referencing the items makes the evaluation more objective and may 
clarify the objectives of the curricultmi. Items should be criterion 
referenced before tests are assembled* If this is done several 
undesirable items are likely to be discovered. 

Conclusions 

The item-sampling technique can be applied effectively to 
formative curriculum evaluation. It has the following advantages over 
traditional achievement testing: 

1. More detailed information is provided. 

2. Planning and review are more effective. 

3. Transient aspects become evident. 

4. Revision is more effectively accomplished. 

5. It is more economical of time and money. 



CHAPTER I 



INTRODUCTION 



There is a growing demand for effective curriculum evaluation. 
Since the introduction of new mathematics curricula over a decade ago, 
scholars have been critical of their evaluation efforts. Criticism 
has been in part aimed at the use of standardized achievement tests 
to evaluate and compare new programs. Standard tests were designed to 
measure other objectives than those espoused by the new mathematics 
programs and they are intended to evaluate individuals, not curricula. 

In addition, funding agencies for curriculum projects (e.g., the 
United States Office of Education) are emphatically demanding more 
quality verification of the products being produced. These agencies 
want to know what they are getting for their money, and they want some- 
thing other than a subjective guess. 

The primary purpose of this study is to present an evaluation of 

the Grade 6 Patterns in Arithmetic program (PIA) which has been devel- 
oped by the University of Wisconsin Research and Development Center 

under the direction of Professor Henry Van Engen. 

The Wisconsin Research and Development Center for Cognitive Learn 

ing was established at the University of Wisconsin in 1964. It is at 

present one of nine federally funded R and D Centers. PIA was the 

first major project undertaken by the Center. This program is a 
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complete arithmetic program utilizing television for grades 1-6, As 
PIA was a Federally funded project, its developmental staff felt the 
pressure for extensive, objective evaluation. Grades 1-5 of the pro- 
gram were produced during the years 1965-1968, A variety of evaluation 
activities were carried out during these years. 

For Grade 6 a new technique was suggested as a method for obtain- 
ing more extensive information about the effectiveness of PIA. This 
technique is called "item-sampling, ” In contrast to the traditional 
type of testing in which every pupil gets the same test, the item- 
sampling technique allows pupils to take one of several different 
tests,. Conceptually, item-sampling considers a pool of m items dis- 
tributed over k tests. The k tests are then administered to the pop- 
ulation it is desired to measure. For example, suppose there are 100 
items about which one desires information. Instead of having each 
pupil respond to all 100 items, one could construct five, 20-item tests 
and administer these tests. In genej'al, the maximum number of differ- 
ent tests that can be used is a function of the number of pupils avail- 
able for testing and the desired accuracy of the sampling estimates. 

A pilot run using item-sampling was made at the end of the de\ 7 elop- 
mental year of PIA Grade 5. As a result of the success of that trial, 
a more involved design was conceived for the developmental year evalu- 
ation of PIA Grade 6. The design was to test at four times during the 
year, each time obtaining information on the same set of 240 items by 
item- sampling. The resulting data would provide a profile of change 
for each item across the year for the population. These item profiles 
would provide project personnel with an objective means of assessing 



strengths and weaknesses of PIA Grade 6. Materials could be revised 
accordingly. 

Therefore, the subject of this study is the application of item- 
sampling to developmental curriculum evaluation. Relevant literature 
will be reviewed in Chapter II. 



CHAPTER II 



BACKGROUND OF THE PROBLEM TO BE INVESTIGATED 



The criticism which has been voiced against the way in which curric- 
ulum evaluations have been carried out seems to run the gamut- -all the 
way from the clarity of the program objectives to the final evaluation 
which reports the merits of the program. 

Scriven (1967) identified two broad types of evaluation- -formative 
and summative. Formative evaluation is done during the developmental 
stages of production in order to identify weaknesses and guide the staff 
in the revision of materials. The distinguishing feature of a formative 
evaluation is that the product still remains open to change. Summative 
evaluation is done on the finished version of the product in order to 
provide the potential consumer with evidence relative to its effective- 
ness. In general, results of a summative evaluation are not used to make 
additional refinements of the product. 

Stake notes that "most contemporary evaluation of instruction begins 
and ends with achievement testing." (Stake, 1967, p. 5) This is not 
to say that achievement testing is necessarily bad, but he emphasizes 
that the primary purpose of an achievement test is to provide an instru- 
ment which reliably discriminates among individuals for the purpose of 
instruction and guidance. Standardized achievement tests cover more 
general skills common to content areas that are likely to be taught in 

a particular program and are designed to be "fair" to all students. 

4 
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Stake believes "the standard achievement test is unlikely to encompass 
the scope or penetrate the depth of a particular curriculum being eval- 
uated." (Stake, 1967, p. 6) 

Curriculum evaluation is difficult to accomplish for the unique as 
well as common features of various curricula must be evaluated both 
objectively by measuring the outcomes of instruction and by personal 
judgements as to the quality and appropriateness of goals. There are 
several points of view currently being advocated as to the relative 
emphasis which should be placed on formative versus summative evaluation 
and comparative versus non- comparative evaluation. Cronbach is more 
enthusiastic about using both formative and summative, non- comparative 
evaluations. He feels that "in an experiment where treatments differ 
in a dozen respects, no understanding is gained from the fact that the 
experiment shows a numerical advantage in favor of a new course." 
(Cronbach, 1963, p. 5) Scriven on the other hand emphasizes the sum- 
mative, comparative evaluation. He argues that "if we want to pin down 
the exact reasons for differences between programs, it is quite true 
that 'small scale, well-controlled studies can profitably be used to 
compare alternate versions of the same course' whereas large-scale over- 
all comparison will not be so valuable. But that in no way eliminates 
the need for comparative studies at soine point in our evaluation pro- 
cedures." (Scriven, 1967, p. 65) Scriven 's most convincing argument 
for comparative evaluation is that one can avoid having to determine an 
absolute scale for reference. For example, suppose you are comparing 
arithmetic programs A. and B with respect to computing with rational 
numbers. If X and X are pretest means and Y and Y are posttest 

3, u 3. D 

means for groups A and B respectively, then the differences Y - X 




6 

and Y, - X, are more meaningful in measuring growth in computing with 
b D 

rational numbers than t - X would be alone. On the other hand, suppose 

a a 

you are using items for which comprehensive normative information is 
available. If the item difficulties are known for the pretest period 
as well as the posttest period, then the difference Y - X , where Y 

ci 3L. ci 

represents the post item difficulty and X represents the pre item 

Si 

difficulty, would form a useful basis for item comparisons. Also, 

Cronbach has argued that it is difficult to equate classes taking com- 
peting courses and that experiments **putting one course against another, 
are rarely definitive enough to justif}^ their cost.” (Cronbach, 1%3, 
p. 5) Despite his emphasis on experimental, non- comparative evaluation 
Cronbach, nevertheless, realizes the need to compare courses if intelligent 
decisions are to be made by administrators, supervisors, etc., but he does 
not see comparative evaluation as the dominant goal. Professor Cronbach 
is obviously emphasizing curriculum perfection, while Professor Scriven 
is more concerned with protecting the interest of the American consumer. 

Tyler finds existing achievement tests of limited value for eval- 
uating complex educational objectives. As an example he cites his ex- 
perience in a project concerned with assessing the process of education. 

The purpose is to appraise the educational progress of 
large populations in order to provide the public with 
dependable information to help in the understanding of 
educational problems and needs and to guide in efforts 
to develop sound public policy regarding education. 

This type of evaluation is not focused upon individual 
students, classrooms, schools, or school systems, but 
is to furnish over-all information about the educational 
attainments of large numbers of people. Although the 
purpose is not identical with that of current achievement 
testing programs, we thought that available tests and/or 
test items would serve our purposes, but this turned out 
not to be the case. (Tyler, 1967, p. 13) 
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One reason Tyler feels that achievement tests are of limited value is 
that the items are designed to discriminate among individuals. For 
assessing the process of education, items are also needed which show 
what most of the children know as well as what the more advanced few 
are learning. 

How Should Course Evaluation be Accomplished , 

Cronbach and others have promoted the concept of "item- sampling" 
as being a very useful technique for both formative and summative eval- 
uation, The use of item-sampling was first proposed by Lord (1962), 

The following definition of item-sampling will be used in this study, 

"In the item- sampling technique, a set of m items is randomly broken up 
into k subsets of items. The k subsets of items are then randomly 
assigned to p pupils or subjects. Each subject takes only a portion of 
the complete set of items," (Cahen, Rcmiberg, Zwirner, 1%«, p. 2) 

For example, suppose there are 100 items about which one desires infor- 
mation, Instead of having each pupil respond to all 100 items, one 
could construct five, 20-item tests and administer these randomly among 
pupils. For the results to be useful there must be a sufficient number 
of responses to each test so that a stable estimate of the difficulty 
of each item is obtained. 

The original purpose of item sampling was to estimate descriptive 
statistics for a group taking a standardized test so that results could 
be compared with the norms. Early work by Lord (1962, 1965) revolved 
around applying the general work in sampling done by Hooke (1956a, 1956b) 
and Tukey (1950) to testing. To establish empirical evidence to support 
the technique. Lord (1962) used item sampling to check how close group 
statistics could be estimated by sampling responses from a test which 
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had been taken in its entirety. Lord sampled items with replacement 
(which he admitted was a mistake) and still found that the test mean 
for the group could be reasonably estimated. 

Lord and Novick discuss the use of item-sampling in research design 
in Chapter 8 of their book Statistical Theories of Mental Test Scores 
(1969). The advantages cited are these; 

1. If only a limited amount of time can be demanded 
of each research subject, the total amount of 
information obtained from a given number of sub- 
jects may be greatly increased by item sampling. 

2. If a test can be administered to only one examinee 
at a time, the examiner's time may be the limiting 
factor: more information about a group of examinees 
may be obtained by giving a few items to each 
examinee than by giving the entire test to just a 
few examinees. 

3. With certain tests, scoring costs may be the limit- 
ing factor; in this case, it would be better to 
score a few items from the answer sheets of every 
examinee than to score every item on the answer 
sheets of a fev7 examinees. 

(Lord and Novick, 1968, p. 252) 

Since the primary purpose of item-sampling is to obtain a stable estimate 
of the difficulty of each item, one commonly assumes that the item 
performance is independent of the context in which it occurs. Lord points 
out that empirical studies have tended to support this assumption. He 
also mentions that item-sampling is not appropriate on speeded tests. 

If one does not have a chance to respond to an item, performance on this 
item is not accurately estimated. Various theoretical results and 
formulas for estimating descriptive statistics are included in Lord's 
Chapter 8. For this study there is no pre existing test on which perform- 
ance must be estimated. Therefore, a discussion of the results and 
formulas associated with estimating test parameters is not included in 
th_s chapter. Since Lord's initial efforts, several individuals and 




gj^oups of individuals hav6 pointod out tiho possibilitios of itom sampling. 

Husek and Sirotnik have recently advocated the use of item- sampling 
in growth studies. The example they cite is the following: ”If a 

course has 100 students and the researcher is interested in obtaining 
some index of growth of the students with respect to a measure contain- 
ing 100 items, by using item sampling it is possible to obtain data on 
all 100 items at several times during the term without any student 
necessarily taking any item twice." (Husek and Sirotnik, 1968, p. 2) 

At present item- sampling has not been used in any reported growth studies. 

Plumlee (1%4) illustrates an interesting possible use of item- 
sampling. She found item- sampling could be used to norm a test which 
would then be given to prospective employees. The population the norms 
would be based upon would be current employees. Item samples would be 
given to the employees and results used to establish a test mean. Each 
employee would be involved in only a few minutes of testing time and 
would respond to a small sample of items in the universe. To obtain 
empirical evidence to support the technique Plumlee obtained data on the 
actual test performance of 200 clerical applicants on a 30-item test. 

The total population of 200 applicants was divided randomly into 10 
subgroups with 20 in each group. Each of these 10 subgroups could be 
used to provide an estimate of the entire group mean and standard de- 
viation. As an alternative to using the performance of one subgroup 
on all 30-items to estimate group performance, Plumlee selected at 
random 3 questions from each applicant's test for each of the 10 sub- 
groups. Lord's formula was then applied to estimate group performance 
fron» the partial data randomly taken from the subgroups. Plumlee found 
"that the estimated test mean predicted by item- sampling is closer to 
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the norms population mean than all but 2 of the 10 examinee-sampling 
predicgions; however, the prediction, by item- sampling, of the total- 
test standard deviation is closer to the norms population standard 
deviation than only one examinee- sampling prediction." (Plumlee, 

1%4, p. 625) One interesting point made by Plumlee has implications 
when item sampling is applied practically anywhere and particularly in 
educational evaluation. She said that "supervisors who fear that 
experimental test results may be used against their employees may be more 
convincingly assured if each employee takes only a part of a test and 
different employees take different parts." (Plumlee, 1964, p. 624) 
Similarly, teachers with classes participating in an experimental pro- 
gram may be more agreeable and comfortable if they are aware that results 
are not going to be used to evaluate individuals. 

Item- sampling has also been used extensively in the National 
Longitudinal Study of Mathematical Abilities (NLSMA) in order to measure 
a multitude of dimensions that conventional testing procedures would not 
allow. NLSMA used item-sampling in a summative- comparative sense and 
results seem promising. (Cahen, Romberg, Zwirner, 1968) Prior to the 
NLSMA application of item-sampling almost all studies related to the 
method attempted to validate the potential utility of the technique by 
sampling from existing banks of data. (Lord, 1%2; Plumlee, 1964) 

Since "complete" data was available the item- sampling estimates of group 
mean and variance could be compared with actual results. One of the 
questions asked by NLSMA was how would data actually obtained under 
conditions of item-sampling compare with actual performance by the group 
on a complete test. To answer this question parallel forms of a 50 item 
Educational Testing Service Cooperative Arithmetic Test (1964) were 
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administered on consecutive days. The first day Form B of the test was 
administered under item- samp ling conditions (5 items on 10 different 
tests) while on the second day the groups were given the entire Fom A 
test. The item-sampling estimates of the groups' mean were almost always 
too high. Two hypotheses were proposed to account for the inflated 
estimates. 

1) Students were allowed slightly more time per item 
under item- sampling conditions. 

2) The student confronted with a short set of test items 
may vary his test taking behavior and be motivated 
differently than when confronted with the entire 
test. 

Since the means estimated by item-sampling in the NLSMA study were 
significantly higher than the observed means on a parallel form, it is 
natural to question its usefulness. For example, can one risk the 
possible error in item-sampling estimates. The answer to this question 
depends upon the use one intends to make of item- sampling. If several 
groups are to be compared using item sampling, then factors which affect 
one group presumably equally affect the other. The two hypotheses 
mentioned above to account for the inflated item-sampling estimates are 
nq longer tenable since all groups are exposed to a more uniform item- 
sampling setting. In fact, if a test were normed under conditions of 
item- samp ling, it is reasonable to expect that comparisons with norms 
would be more valid. The following quote from the NLSMA report sum- 
marizes some of the uses as well as problems presented by item- sampling. 

The item- sampling technique should have great application 
for curriculum evaluation where information about the 
group rather than individual performance has high feed- 
back payoff for the innovator and evaluator.... In one 
testing session in the study over 10 scales were item 
sampled, including measures of pupils' attitude toward 
mathematics, . , . 
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Depending upon the desired level of precision, it liuiy 
be possible to determine how many different sets of 
items need be sampled and the number of students 
required on each form or booklet in order to stay 
within the specified error range.... The data indicated 
that precision of estimation is monotonically related 

to the number of students tested The study indicated 

that care must be taken in the future with the problem 
of establishing accurate time limits for item- samp ling 
administration when the purpose of item sampling is 
to estimate absolute rather than relative parameters 
of school performance. 

(Cahen, Romberg, Zwirner, 1968, p. 12-14) 

Knapp has suggested the use of item- sampling in obtaining a more 
realistic set of normative data for standardized achievement tests. 

Often test developers experience difficulty in getting cooperation from 
school officials to generate data for establishing norms. Knapp, like 
Lord, reasons that schools would be more willing to cooperate with testers 
if pupils involved were required to take only a small sample of items in 
a fraction of the normal testing time. The unique feature of Knapp s 
work is his application of the balanced incomplete block design (BIBD) 
to item- sampling. The parameters he is interested in estimating are the 
mean, variance, and internal-consistency reliability coefficient of a 
test. Knapp presents some empirical results to demonstrate the effective- 
ness of the BIBD technique. In concluding he summarizes: "This method 

applies the logic of item- sampling and balanced incomplete block designs 
to parameter estimation and is extremely economical of testing time." 
(Knapp, 1968, p. 272) Cne weak point of the study was his failure to 
give reason why one would expect the BIBD design to be superior to other 
less restrictive designs. Another implied assumption made by Knapp is 
that normative data based upon item- sampling would serve as a valid base 
for another group taking the entire test. Results of the NLSMA study 
described above tend to cast doubt upon the validity of thi.s assumption. 
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Stuffelbeam is much opposed to the traditional application of ex- 
perimental design to evaluation problems. This method, first used in 
agricultural experiments, involves testing hypotheses about the effect 
of treatments where treatments (in this case, programs) are randomly 
assigned to plots (here classes). His four objections to the experi- 
mental design approach are; 1) It interferes with continual improve- 
ment of the program since significant differences make no sense unless 
the program remains the same. 2) Although the experimental design may 
be useful for summative evaluation, it is practically useless for making 
decisions during the formative stages. 3) It is difficult to control 
potentially confounding variables by randomization. 4) Although one 
can be confident of the findings in a well controlled experimental 
situation, it is not necessarily true that the results will be general- 
izable to a typical classroom situation where factors are not so nicely 
controlled. Also, Stufflebeam considers the problem of process evaluation. 

As opposed to experimental design evaluation, process 
evaluation does not require control over assignment of 
subjects to treatments, nor that the treatments be 
held constant. Its purpose is to assist project 
personnel to make their decisions a bit more rational 
in their continual efforts to improve the quality of 
the program.... The process evaluator focuses his 
attention on theoretically important variates, but 
he also remains alert to any unanticipated but 
significant events. Under process evaluation, infor- 
mation is collected daily, organized systematically, 
analyzed periodically, e.g., weekly, and reported as 
often as project personnel require such information. 

(Stufflebeam, 1%8, p. 35-36) 

The preceding paragraphs have pointed out the need for more effective 
curriculum evaluation- -both formative and sivnmative. A case against 
using the traditional experimental design technique was made and the 
technique of item- sampling was explored in several studies. Granted 
that item- sampling makes it possible to gather more information than. 
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for example, traditional standardized achievement testing, the problem of 
what to do with the information still remains. One of the obvious un- 
stated assumptions made by advocates of item-sampling is that the items 
upon which information is gathered test important objectives. In par- 
ticular, if item-sampling is applied to formative curriculum evaluation, 
the chosen items should provide feedback that aid the curriculum developer 
in improving (revising) his product. For a given curriculum it is fash- 
ionable to state goals in terms of "behavioral objectives"--!. e. , as a 
result of exposure to this curriculum what should the individual be able 
to do. If an item is selected to test one of the objectives of instruction, 
two important and related questions may be asked. 

1. How involved is the item with respect to the 
objective tested? 

Is it a simple, direct question or one which 
requires an insightful application? More 
succinctly, where does the item fit in 
Bloom’s Taxonomy? 

2. For a given group of individuals, approxi- 
mately what per cent should respond correctly 
to the item if the curriculum is to be. 
considered successful with respect to the 
tested objective? 

For the curriculum developer the answer to question 2 is crucial and 
obviously dependent upon the answer to question 1. 

The technique of "criterion referencing" has been used to answer 
a slight twist applied to question 2--namely, for a given individual, 
approximately what per cent of a group of items should be answered 
correctly if the individual is to be considered successful with respect 
to the objective(s) tested by the items. Criterion referencing is 
discussed in the next section and Chapter V proposes a modification to 
the technique that vjill apply to formative curriculum evaluation. 



Measuring Success 
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From our earliest experiences in school we are aware that individuals 
differ in aptitude. In fact, educators are aware that aptitude has many 
dimensions and that one must be careful to label the kind of learning 
(e.g., mathematics, history) when speaking of ones aptitude. Many 
aptitude tests have been written which predict (correlate highly with) 
an achievement test given at a later date. It is likely that the high 
aptitude-achievement correlation has tended to set goals for teaching. 
Carroll (1%3) has indicated th.at if pupils come into a course with 
normally distributed aptitude scores and if they are all given the samp 
instruction, then the end result will be a normally distributed set of 
achievement scores. Carroll sees no reason why the focus of instruction 
can not be changed so that the net result after instruction would be a 
skewed distribution of achievement scores with a long left tail. Most 
pupils would be able to demonstrate mastery of the given task and the 
achievement scores would likely be less correlated with traditional 
aptitude tests. Use of the phrase "mastery of a learning task" implies 
that given a task one can objectively specify a criterion (score on a 
test, etc.) that provides a valid dichotomous classification of individ- 
uals — one group being "masters of the task" and the other group being 
"non-masters". The score which serves to split the group is referred to 
as the criterion score and testing which uses such a score is referred to 
as criterion referenced testing. 

Bloom (1968) believes that approximately 95 percent of ail individuals 
can learn a subject up to a high level of mastery. To accomplish this 
some students require more time and varied approaches to the material 
to real criterion level, i.e., one must allow for individual differences. 
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Bloom discusses several preconditions and operating procedures which 
determine the success of mastery learning. 

1. One must be able to determine when a student has 
demonstrated mastery of a ta?k. 

2. Standards of mastery should be relatively independent 
of inter-student competition. At the same time pre- 
vious experience with student performance should be 
useful in establishing a criterion for mastery. 

3. Feedback should be frequent and on small fundamental 
units of instruction. 

4. The diagnosis should be accompanied by a prescription 
so students can overcome difficulties. 

To date, most applications of criterion referenced tests have been made 
with the criterion score set for the purpose of making a decision about 
the learner. Glaser (1968) has developed a program of individually 
guided instruction (IPI) for elementary school children. His program 
uses the concept of a criterion score to determine whether a pupil has 
mastered a unit of instruction or whether he needs to repeat the unit. 

A curriculum is viewed as a long branchi.ng chain with each of the upper 
branches depending upon those beneath. Thus, having "mastered” the 
lov 7 er level branches one can proceed to master those branches above. 

The entire program is individualized in the sense that the pupil may 
proceed at his own rate through each unit of a subject. Every pupil is 
exposed to the same units of instruction, but some pupils achieve criter- 
ion scores at various rates. Teacher aids take care of the testing and 
scoring of the criterion referenced test. The setting of criterion 
scores was done by members of Glaser’s staff. 

So far, most users of criterion referenced tests have set a seem- 
ingly high criterion score. A criterion of 80 - 90% correct responses 
is not an uncommon level. A closer look at the IPI program shows 
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clearly why such a high criterion level is not unreasonable. First, the 
criterion referenced tests are generally composed of items from the lower 
to middle level of the cognitive scale since most items test routine 
skills and simple applications of concepts presented. Secondly, the 
criterion referenced test is administered immediately following the 
instructional unit it is designed to test. Thirdly, the pupil is con- 
ditioned for some items on the test by being exposed to very similar 
items introduced in the Instructional unit. Fourthly, if a pupil does 
not meet criterion he repeats the same unit again and takes the same test 
over. Therefore, a criterion level of 80 - 90 % is not an unreasonable 
goal. 

The above discussion of criterion scores related to mastery learn- 
ing seems to imply that they are only useful for making decisions about 
individuals. However, important decisions must also be made in formative 
curriculum evaluation. Weaknesses must be identified so materials can 
be improved. Therefore, it is reasonable to ask if the single score 
criterion used to dichotomously classify individuals can be modified to 
be useful in formative curriculum evaluation. This question is attacked 
in Chapter V . 



CHAPTER III 



THE STUDY 



The Setting of the Study 

The Wisconsin Research and Development Center for Cognitive Learn- 
ing was established at the University of Wisconsin in 1964, and is at 
present one of nine R and D Centers funded under contract with the 
United States Office of Education. One of the first major projects 
undertaken by the Center was to develop, implement, and research a six- 
year television program in mathematics for the elementary school. Aside 
from the TV aspect, a distinctive feature of the program is its emphasis 
on inservice education for teachers while providing a sound program in 
arithmetic for pupils. The program, hereafter referr^:d to as Patterna 
in Arithmetic (PIA) , was developed over the period 196 '^-69. Grades 1 
and 3 were developed the first year, grades 2 and 4 the second, grade 
5 the third, and grade 6 the fourth and final year of the project. 

Three distinct aspects of the PIA program can be identified at 
each level: (1) The individual TV tapes (2) Teacher Notes and (3) Pupil 

Exercises. In general, decisions relative to the success of individual 
TV tapes were made on a subjective basis after viewing the program in 
the classroom and getting the comments from teachers at regularly sched- 
uled meeting. Modifications to the Teacher Notes and Pupil lilxerciscs 

based upon classroom visits, meetings with teachers, and regularly 
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scheduled testing activities. 

Several evaluation techniques were used in the field testing of 
grades 1-5 of the program. The techniques ranged from periodic check- 
up exercises during the developmental years of the program to extensive 
standard achievement testing done in grades 1-3 following the develop- 
mental year. (Braswell, Romberg, 1969) Also, for grades 1 and 3, 
Educational Testing Service developed several test instruments specif- 
ically designed to fit the terminology and objectives of PIA. These 
tests were administered after the developmental year when grades 1 and 
3 were in final form. In addition to the testing activities, periodic 
meetings were held with the teachers using the developmental materials, 
and regular classroom visits by members of the PIA staff were used in 
evaluating the materials. 

Testing done during the development of programs for grades 1-5 
consisted of preparing periodic check-up exercises based upon content 
most recently covered. While useful, this method provided little oppor- 
tunity to measure what happened to a concept or skill over the entire 
year. Nor did the testing provide the staff that was responsible for 
sequencing and planning program content with concrete evidence relative 
to what pupils knew about a topic before it was presented. It is rea- 
sonable to believe that the staff could assemble more efficient mate- 
rials if reliable data representing program objectives over the entire 
year were available. A step directed toward this goal was taken at 
the end of PIA Grade 5. 

Near the end of the developmental year of PIA-5 a modest pool of 
items was developed to assess the degree in which program objectives 



had been accomplished and to provide staff with data covering a variety 
of concepts and skills that would be useful in program planning over 
the summer for PIA-6. In all 180 items were arranged on nine, 20- 
item tests. The tests were mailed in quasi-random order to the various 
classes participating in the developmental year program. Typically, 
about three members of each class responded to each of the nine tests. 

The net result was that between 154 and 172 pupils responded to each 
test, and reasonably stable estimates of performance on 180 items were 

secured. 

fo interpret the data nine major content areas (e.g., fractions, 
geometry, division) were identified for PIA-5. Each item was classified 
as belonging to one or more of these areas. Of the 180 items, 40 could 
be identified as relating to fractions. Traditional testing would have 
provided information on only a total of approximately 40 items with 
perhaps 6 or 8 relatea to fractions. Each of the nine content areas 
had many important dimensions and using 180 items it was possible to 
evaluate most of them. It should be clear that one is not particularly 
iritereiited in a test mean or even individual scores. These aspects 
are onl.y of passing interest. The useful results are the item diffi- 
culties and the evaluator merely "uses” individuals to provide stable 
estimates of item difficulties. 

The information provided by this testing procedure was more compre- 
hensive and informative than that provided by the earlier procedure of 
using a single set of check-up exercises with only 30 or 40 items. With 
this background there was reason to believe that for PIA-o, a similar 
but more sophisticated evaluation scheme could be used over the entire 
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This study extends the use of item-sampling to formative curriculum 
evaluation. The paragraphs below discuss briefly the nature and scope 
of the study. Other chapters will give a detailed account of the method, 
results, and conclusions. One anticipated conclusion is that item- 
sampling can be used effectively as one tool in formative curriculum 
evaluation. However, considerable preparation must be made if the 
method is to succeed and the evaluator must be keenly aware of the 
relationship that exists between the parameters of his population and 
the conclusions he hopes to draw. 

Problem.s Investigated 

Since this study was a formative evaluation of the PlA-6 program, 
all problems revolved around the technique used for gathering infor- 
mation about pupil performance on a particular set of items relevant 
to that program. One purpose of gathering the data was to provide 
periodic information to the staff so that intelligent decisions could 
be made during development. The study was designed so that information 
related to particular items as well as more general content areas could 
be provided. The study also proposes a modification to criterion 
referencing as applied to individuals that was useful for objectively 

interpreting the data provided by item-sampling. 

The use of item-sampling involves four dependent dimensions: 1) 

the sample size 2) the accuracy of the sampling estimates 3) the total 
number of items used and 4) the number of items per test. This study 
sheds light on the practical relationship among these dimensions as they 
relate to formative curriculum evaluation. 
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During the school year a pupil is exposed to many "treatments" 
in a variety of subject matter areas. In arithmetic, for example, a 
pupil may be exposed to five periods of instruction per week. Each 
treatment is assumed to have some effect in developing concepts and 
improving skills. For PIA-6 the main instruction occurs twice weekly 
and is highlighted by a short TV arithmetic program. In all there 
are 64, 15 minute programs designed to be shown twice weekly. Teachers 
have definite responsibilities before, during, and after each TV 
program. Together, the pretelecast, telecast, and follow-up activities 
provide a concentrated treatment. Ideally, it is desirable to get 
pre- and post -treatment measures for each program to evaluate its 
effectiveness. When this is economically unfeasible a compromise 
must be made and data is collected less frequently. For this study 
it was decided to collect extensive data four (approximately equally 
spaced) times during the year. The entire PlA-6 arithmetic program 
can be viewed as 64 distinct programs or treatments. Periodically 
the group of sixth graders participating in the study were tested. 

The results of the testing were used to evaluate the treatments that 
preceded the testing period. Figure 1 Illustrates the general pro- 
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The horizontal line represents the school year. Above this line 

represent the 64 programs provided by PIA-6. Below the line T^, 

^2’ ^3’ ^4 four testing periods as they occurred 

0 

during the year. followed Program 5, followed Program 20, 
followed Program 41 and T followed Program 63. 

The design described above is similar to the "Equivalent Time- 
Samples Design" described by Campbell and Stanley (1963). Obser- 
vations are made periodically and the experimental variable is intro- 
duced repeatedly. If the experimental variable (treatment) is having 
an effect, one would expect k discontinuity in the measurements made 
at Tj^, T^j T^ and T^. If the same test items are used at each testing 
period one gets a profile of item change across the year. 

In Appendix B a growth profile is plotted for each item. The 

I 

profile is located beside the test item. Figure 2 illustrates the 
item profile for item 14 on Test 11. The four testing periods are 
represented along the horizontal axis and the percent responding 
correctly (item difficulty) is plotted along the vertical axis. 

The triangular region (s) along the horizontal axis represents major 
program coverage at that point during the 
school year. The location of the triangle 
is a good approximation of where topic 
coverage occurred relative to the four 
testing periods. For this example, the 
item was very difficult at Tj^ and T^ since 
there was no attention given to the problem 
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Figure 2 

Growth Profile for 
Item 14, Test 11 



result of extensive 



by the program. However, at there is growth as a 
coverage iimnediately following T 2 * The horizontal line at 80% repre- 
sents the criterion level associated with this item. The five criterion 
levels are defined in Chapter V. This item was slightly below criterion 
at T^ and T^. 

A profile is obviously useful in evaluating the effectiveness of 
the program with respect to the item considered. If comparable samples 
of pupils can be provided at each testing period, then baseline data 
provided by testing at Tj^ can be used to determine the effects of the 
intervening treatments. Moreover, if the treatment related to a given 
time occurs between T£ and T^i then data from Tj^ and T 2 provide base- 
line data to compare the results from T^. The method used for obtaining 
comparable samples of pupils will be discussed in the next chapter. From 
Figure 1 it is clear that no baseline data was available to measure the 
success of Programs 1-5 since these programs were presented prior to Tj^. 

This design is also useful where the treatment may be transient in 
nature. For example, a concept taught just before T 2 may show up 
extremely well at T 2 , but show considerable decay at T^. The occurrence 
of this event would normally suggest revision or the need for review 
exercises. Item profiles were used during the developmental year to 
modify the program materials. Examples that show how the data was used 
are included in Chapter VI. 

The sixth grade pupils participating in the study were divided into 
two groups. One group used PIA-5 the previous year and the other group 
used some other program. Group membership was determined by noting how 
a pupil answered the question "Did you use Patterns In Aritlimetic in 



grade 5?‘‘ Separate data analyses were done for each group. The group 
distinction served as a basis for assessing the cumulative effects of 
PIA. For example, it was expected that those using PIA -6 who had also 
participated in PIA-5 would do better on some of the more dependent 
topics. In particular, geometry should be an area where previous expe- 
rience in PIA would be beneficial. Any attempt to compare these two 
groups must be made with reservation since the size of the group that 
did not use PIA-5 was fairly small and hence the standard error of the 
estimate is rather large. 

The test items were gathered during the summer of 1968 and covered 
objectives developed during the planning sessions over the spring and 
summer months of 1968. Some test items were written by the PIA staff 
and a sizeable number were taken from existing test instruments. The 
sources of the latter type and general characteristics of the items will 
be discussed in Chapter IV. 

Following the selection of the item pool twelve, 20~item tests were 
assembled. The twelve different tests served as a basis for all testing 
done during the year. The testing periods were in September (T^), 
November (T 2 ), February (T 3 ) and May (T^) . At each testing period all 
tests were administered to the two groups- -the group that used PIA in 
grade 5 and the group that used some other program in grade 5. The 
tests were numbered from 1-12 and pupils were assigned a test number 
at each testing period. It was desirable that a pupil take a different 
test at each testing period while maintaining a degree of randomness 
that would not affect the item-sampling model. A cl.ass list was kept 
for all classes and a copy sent to the teacher to indicate which 
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numbered test a pupil should take. A sample class list is included in 
Appendix B. The rationale for having a pupil take a different test 
each time and the method of assigning tests to pupils is discussed 
in Chapter IV. 

A general definition of item-sampling was presented in Chapter I, 
From the discussion above it is clear that this definition was approx- 
imately satisfied at each of the four testing periods. Namely, a set 
of 240 items (12 tests, 20 items per test) was broken up into twelve 
tests (subsets) of twenty items each. The break-up was not strictly 
random as required by item-sampling. To meet conditions (2) and (3) 
described above it was necessary to control the assignment of items 
to tests. A strict random assignment of items to tests would not 
necessarily have provided "balanced" tests. Each test was then as- 
signed randomly at each testing period to a subset of pupils in the 
study group. 

Many, if not most, of the items were difficult at the beginning 
of the 3 >^ear. However, at various points during the year most of the 
items showed a pattern of decreasing difficulty, especially on the 
test administration following the period of topic coverage. In most 
cases, item growth could be explained directly by the program. 

The technique used in the study should bs of interest to other 
persons involved in formative curriculum evaluation. It is certainly 
reasonable to believe that using two, three, or even four hundred well- 
chosen items for a formative evaluation should provide more information 
to project personnel than using a 40 or 50 item standardized test. 

When doing any kind of testing it is theoretically nice to ask the 
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question "How can I get the most information per testing time involved?" 
Once you have selected a pool of items to cover program objectives then 
comes the question of how to make the most efficient use of these items. 
This study sheds light on how many responses to an item are necessary 
to obtain a stable (percent responding correctly to an item). Will 
100 random responses to an item produce a more useful P^ than 50 
responses, or are 150 responses necessary? For a given pool of items 
the answer to this question can be used to reduce the testing time 
involved or decrease the population required for the study. 



CHAPTER IV 



THE INSTRUMENTS AND THE POPULATION 



The Instruments 

The final product consisted of twelve, 20-item tests (see Appendix 
B) , Since each class would be taking a variety of tests at each of the 
testing periods, it was desirable that they be similar in length. In 
addition to the length factor the following other similarities existed 
between the tests, 

1) The first 13 problems were multiple choice and the last 7 were 

completion (work out the answer and record it) , 

2) Every long division problem with a remainder was to be worked 
on the back of the answer sheet, 

3) All answers were recorded on a one page answer sheet which was 

stapled to the question sheets, but removed at the beginning 
of the testing session, ^ 

4) No matter which test was taken, all pupils received the same 
set of basic instructions from the teacher. 

Previous testing done in PI/» _ ..emonstrated the general format adopted 
was convenient and that instructions were easy to follow. All multiple 
choice items included 3 or 4 distractors. Usually both t3q)es appeared 

on a test, but there was no evidence that this caused any difficulty. 
Constructing the instruments was the most difficult part of the 



study. They had to be constructed well in advance of the beginning of 
the 1968-69 school year since the first administration was in September, 
1968. The first TV program was taped on July 9, 1968. By this date 
the entire pool of items had already been constructed and the tests 
were on the assembly line. It is obviously very difficult to extrap- 
olate program content over an entire year. A crude outline of program 
content was available and it was from this outline that Table lA was 
constructed. Table 2A specifies approximately the percent of coverage 
each major topic and sub-topic should receive relative to the entire 
set of twelve rests. These tables are located in Appendix A. 

Some topics were not completely planned prior to construction of 
the tests. Non-metric geometry was one such topic. Rather than risk 
including irrelevant items , the less well defined areas were not 
adequately covered. Quarterly Check-Up exercises designed for inclusion 
in Pupil Manuals were used to test these less well defined areas. The 
Check-Up exercises were composed after related programs had been planned 
in detail. 

Basic terminology established in PIA grades 1-5 was used in the 
writing of items for PIA-6. The items chosen to satisfy Tables lA and 
2A came from three sources: 1) Tests supplied by Educational Testing 

Service (ETS) 2) Tests used in the National Longitudinal Study of 
Mathematical Abilities 3) Items written by the PIA staff. The follow- 
ing tests furnished by ETS were reviewed and one or more items were 
used from each of these tests: 

The Cooperative Mathematics Test: Arithmetic; Forms A, B, and C 

The Ohio Survey Tests, Grades 6 and 8, 1967 edition 
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The Cooperative School and College Ability Test? (CSCAT) , Forms 
4A, 4B, and 5B 

It should be mentioned that some items used from existing tests were 
modified slightly to be consistent with the terminology and objectives 
of PIA. This is a reasonable thing to do because no attempt is being 
made to compare PIA pupils to any previously established norms. 

The task of assembling the pool of items occupied the majority of 
the month of June, 1968. Items were collected for each major heading 
and subheading listed in Table lA. They were assembled by topic area 
(e^g., all items on fractions were placed together) and reviewed by 
at least two other staff members. Items were collected in excess of 
the number needed to allow for culling. Various staff members made 
comments on the appropriateness, terminology, etc. of each item. 
Following this stage a reduced pool of "acceptable" items was formed. 
The final reduced pool contained about 350 items from which 240 were 
to be selected to fit the twelve, 20-item tests. There is nothing 
magic about the number 12. In fact, the present study would have 
been better if more item types could have been used. However, as for 
any study, its scope depends upon several important factors: the 

availability of stc.ff, the funds to support the project, and size of 
the population. 

In constructing instruments for a formative evaluation one ideally 
seeks maximum information at minimun inconvenience to teachers and 
administrators. Class time for testing is certainly a factor. In the 
present study it was felt that 30-35 minutes of testing time at four 
times during the year was not unreasonable. By using tests of 20 items 



31 

each, it was possible to take up a short amount of class time and yet 
get information on 240 items each time. 

Once the acceptable pool of items had been established there 
remained the task of assembling each of the tests. To accomplish this 
all items were cut apart from a listing by content area and placed on 
several large tables. Homogeneous (by content area) items were placed 
together. The reason for this was to make it easier to get broad cover- 
age on each test. In fact, every effort was made to include a variety 
of topic coverage and item difficulties on each test. There were two 
main reasons for having broad coverage on each test. First, if one test 
contained all items representing one coptent area (e.g., decimals) then 
performance at T^ (the first testing period) would have been almost nil 
since fifth graders have had little experience with decimals. What 
makes this bad is not that performance would be almost nil, Hit that 
other tests which had more familiar types of items (e.g., measurement) 
would have required more time to complete. It is not desirable to 
have one test that requires 5 minutes for completion (because the pupil 
knows nothing about the questions) and another that requires 15-20 
minutes for completion (because the content is more familiar). Second, 
by having broad coverage on each test one gets a more realistic picture 
of group performance on a given topic simply because more pupils respond 
to items which cover the topic. This tends to make the results of the 
testing more genera lizable. 

Although the above are the two main reasons for having broad cover- 
age the pupils probably prefer variety to homogeneity in coverage. Thus 
pupils who are weak in one area may find problems they can work in other 
areas and not get discouraged. In addition to a variety of covsr- 



o 

ERIC 



age on each test there were also a variety of item difficulties. Each 
test started with a very easy item (even at but the items did not 

get progressively harder. Easy and hard items were intermixed through” 
out the test to avoid having the pupil become discouraged early. The 
fact that these tests were not speed tests makes the intermixing of 
easy and difficult items more reasonable. In fact, although a time 
limit of 35 minutes was specified for the testing session, rarely did 
a pupil fail to respond to the final item. Thus, each test was con- 
structed by selecting items from a variety of content areas and repre- 
senting a variety of levels of difficulty. After Test 9 was construc- 
ted a bit of accounting was done to see how the overall coverage com- 
pared with Table 2A. Tests 10-12 were then constructed keeping in mind 
those areas which were neglected in Tests 1-9. Also, a few test items 
were interchanged to provide for better balance. When all tests had 

i 

been assembled via cutting and pasting, each item was proofed. Each 
test was then typed and proofed again before being duplicated. A few 
errors were made in the final version, but none serious enough to cause 
problems. Some test items were modified slightly from the first test- 
ing period. These items and the modified form are given in Appendix 
B. No items were changed which represented content covered in PIA-6 
before T^ (the initial testing period). Significant changes in an 
item would interfere with one’s ability to interpret results. If one 
is going to make statements about pupil performance on items or groups 
of items that are administered at several times during the year, it is 
absolutely necessary to hold the item constant and not manipulate in- 
structions, terminology, distractors, or even the location of the item 
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on the test. The effect of such manipulation is not an objective of 
a formative evaluation. 

At each of the four testing periods (T^, T^, T^, T^) one gets a 
measure of item difficulty for each of the 240 items. The extent to 
which these measures (estimates) are useful depends upon how accurately 
the estimates approximated the true item difficulty for the population 
participating in PIA-6. For a population (number of classes) of 
fixed size this accuracy depends upon how well the sample represents 
the population, i.e., is the sample random. If one is confident that 
the sample is random then the response pattern follows a binomial distri- 
bution and a confidence interval can be placed about the difficulty 
for each item. In general, very easy or very hard items require 
fewer random responses to establish stable estimates of item diffi- 
culty than middle difficulty items (those which are answered correctly 
by 40-60% of the respondents). 

TABLE 1 

STANDASD ERROR OF MEASUREMENT FOR RANDOM SAMPLE SIZES 130 AND 30 
WHEN P IS THE TRUE PROPORTION KNOWING THE CORRECT ANSWER 





STANDARD ERROR I 


. PCq)_ 


N = 130 . 


N = 30 


0.1 (0.9) 
0.2 (0.8) 
0.3 (0.7) 
O.A (0.6) 
0.5 (0.5) 


0.024 

0.035 

0.040 

0.042 

0.044 


0.055 

0o073 

0.084 

<0.089 

0.091 



Table 1 shows the standard error of measurement for random samples of 
size 130 and 30. This table assumes a binomial model with p represent- 
ing the true proportion who know the correct answer. It is clear from 
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this table that the error of measurement increases as p increases from 
O.i to 0.5. The standard error function for the binomial distribution 
is, of course, symmetric. The numbers 130 and 30 were chosen because 
they approximate the average number of responses to each test for 
groups which will be discussed later. From this table it is obvious 
that for a random sample of size 30 one does not get a very stable 
estimate of item difficulty, particularly for p in the range 0.2 - 0.8. 

To get a measure of how stable the estimates of item difficulty 
actually were, four items appeared on two different tests. For example: 
the problems at Test 3, item 7 and Test 10, item 3 were the same. Three 
other problems appeared on two different tests. Both the group that 
used PIA-5 and the group which did not use riA'5 responded to every test. 
Since these groups differed in. size it was possible to observe hov; 
stable the sampling estimates were for three cases: (1) The group not 

using PIA-5 (N- Group) (2) The group that used PIA-5 (Y-Group) and (3) 

The N-Group and Y-Group combined (C-Group) . On the average about 30 
students responded to each test trom the N-Group, 90 students from the 
Y-Group and 120 students from the C-Group. In genera? there was a 
tendency for the larger group size to yield more stable (less variable) 
estimates (see Table 2). A few cases occurred in which the estimates 
for the smaller sample sizes were closer than those based upon a larger 
sampJe size. However, this is not unusual. 

Table 2 clearly shows that about 120 random responses will produce 
a fairly useful estimate of the item difficulty-useful in the sense 
that a given item shows stability when located on two different tests. 

It is important to know that the response pattern of the sample is 







TABLE 2 



1 i:^ STABILITY REPORTED AS PERCENT RESPONDING CORRECTLY AT Tj^-T^ FOR FOUR TEST ITEMS 

I THAT APPEARED ON TWO DIFFERENT TESTS. RESULTS ARE REPORTED FOR THREE GROUPS; N- GROUP, 

[ APPROXIMATE SIZE 30; Y-GROUP, APPROXI14ATE SIZE 90; C-GROUP, APPROXIMATE SIZE 120 





ITEM 


'h 


PERCENT 


^2 


PERCENT 


^3 


PERCENT 


^4 


PERCENT 


ITEM 


LOCATION 


N 


Y 


C 


N 


Y 


C 




Y 


C _ 


N^ 


Y 


C 


A 


(3,7)* 


63 


84 


78 


68 


82 


76 


83 


82 


83 


89; 


86 87 




.. (10- 3) 


65 


77 


75 


83 


80 


81 


73 


88 


83 


87 


93 


:f2 


B 


(6,16) 


6 


23 


18 


46 


64 


56 


61 


49 


52 

r 


64 


64 


64 




(8,14) 


6 


18 


15 


41 


65 


59 


53 


68 


63 


66 


70 


69 


G 


(9,13) 


7 


10 


10 


27 


22 


23 

r 


19 


33 


29 


43 


p ^ 

41 41 




(12,6) , 


18 


15 


17 


28 


23 


30 


30 


26 


28 


■ 16 


39 33 


D 


(1,1?) 


Modified 


68 


55 


58 


67 


65 


66 


61 


62 


62 




r, 19) 


at Ti 


« 


48 


56 


55 


56 


61 


59 


49 


54 53 



f ' 

* (3,7) Refers to Test 3, item 7 
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typical of the group because the inferences one makes from the growth 
profiles are based upon this assumption. At each testing period a 
different random saifiple of pupils respond to any given item. If a 
significant change in performance on an item occurs one must be con- 
fident that the change is a result of instruction and not a function 
of the particular sample responding to the item. Chapter VIII will 
discuss the error of the sampling estimates in detail. 

Characteristics of the Populatio n 

Letters inviting participation in the developmental year of PIA-6 
were sent to administrators representing areas which had participated 
in the earlier developmental years of PIA. The tapes were aired during 
the developmental year over WHA-TV, the University of Wisconsin TV 
station. Since reception range of WHA is limited to within approximately 
50 miles of Madison, Wisconsin, participants were restricted to this 
area. Based upon response to the invitation, approximately 100 classes 
expressed interest in participating in PIA during the developmental 
year. Test materials for the first testing period were sent to all 
schools who "signed-up" during the summer of 1968. 

A letter informed prospective participants of the planned testing 
procedure. Of the 96 sets of test materials sent out, 62 sets were 
administered and returned- as directed. The classes represented by 
these 62 sets of materials formed the population for the formative 
evaluation. Most of the classes that participated in the study repre- 
sented medium to small size rural Wisconsin communities. Six classes 
from Monona Grove, an upper, middle-class suburb of Madison, Wisconsin, 
and three classes from Janesville, VJisconsin, a city of about 50,000 
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also participated in the study. None of the classes participating in 
the study represented -large industrial comm-jnities. Also, it is 
likely that few participants represented minority groups. 

Since many areas involved in the study had participated in PIA-5, 
it was expected that the majority of participants would not be new 



to the Patterns program. In fact, 1085 of the 1581 pupils partici- 
pating in participated in PIA-5 during the 1967-68 developmental 
year. Table 3 shows how characteristics of the population changed 
over the four testing periods. New pupils are thf'^e who participated 
in the testing at a given pdriod, but di.d not participate previously. 
No new pupils are included in the analysis following T 2 . Pupils lost 

are those absent or transferred based on resfilts from T, and^^T . 

1 2 



TABLE 3 

CHARACTERISTICS OF THE POPULATION 



Testing Period 







T 

2 


"3 


^4 


Number classes 


62 


58 


58 


57 


Number Pupils 


1579 


1484 


1465 


1432 


New Pupils 




52 


0 


0 


Pupils Lost 




87 


120 


105 


New Classes 




0 


0 


0 



For the initial testing period materials (see Appendix B) were 
se *t to school personnel since the names and addresses of most teachers 
were not available. Depending, upon the school district the following 
types of individuals acted as coordinator for the project: mathematics 

supervisor, school principal, district administrator, elementary super- 
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visor, or a staff member under the superintendent of schools. These 
individuals performed an invaluable service, not only in the testing 
program, but in providing overall support for and implementation of the 
project . 

A form was sent out with each package of materials (see Appendix 
B) to provide the staff with an accurate record of names and addresses 
of teachers participating in the testing program. As answer sheets 
were returned for each class, a detailed class list was made for each 
of the 62 classes who returned materials. The class list contained a 
place to record the following information: 

1) The number of pupils in the class 

2) The complete name and address of the teacher 

3) Approximate time required for the testing for each of the 
four testing periods 

4) The number of pupils absent 

5) The name of each pupil participating in the testing 

6) The number of the test taken by each pupil at each testing 
period 

7) A place to indicate participation status in PIA-5 . 

A sample class list is included in Appendix B. 

Assigning Pupils to Tests 

Following the initial testing period tests were assigned to each 
pupil for the remaining three periods. Since the method for accomplish- 
ing this was one of the important decisions in the evaluation, a detail- 
ed discussion of the procedure will be given. 

First, it was desirable that each pupil take a different test at 
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each oi! Lhc Hour testing periods. The reasons for this are: 

1) That some learning specifically related to the test might 
result. It is not unreasonable to expect that the effect of 
learning on taking the same test would be different from its 
effect on taking a different test. Learning, as used here, 
includ'.s not only becoming familiar vjith the test format, 
instructions, etc., but also being affected by the test 
content. The latter effect would be more likely in this 
testing situation than in more traditional testing because 
the test content involves topics that range over the year. 

Being asked a question on a topic that one is not prepared 
to answer at the beginning of the year could provide a cue 
that would influence performance once the content related to 
that topic is reached on the program. 

2) It would be likely that unequal numbers of pupils wojuld dup- 
licate responding to a given test each t^me if tests were 
assigned on a random basis. For example, 10 pupils might 
take Test 1 at both the first and second periods, while 20 
pupils might duplicate taking Test 8. It would not be easy 
to assess the effect of this on the results. 

c 

3) The way a pupil approaches or answers a problem initially 
could affect his response if he received the same test again. 

4) Although not likely, without restricted random assignment a 
^>dTew pupils could get the same test all four times. It is more 

likely that several pupils would take a given test three times. 
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At the initial testing period the 12 tests were sent out in a repeating 
pattern of Tests 1-12 (the pattern not necessarily beginning with Test 
1) and the teacher was instructed to distribute the tests just like 
they arrived. Following the instructions led to two desirable outct . >. 

First, approximately equal numbers of pupils responded to each test 
(see Table 7, Chapter VI). Second, a class size of betwc-in 11 and 24 
pupils took each test at least once; one between 23 and 36 took each 
test at least twice, etc. The second aspect provided balance in the 
distribution of tests across classes. To insure that this balance 
continued for the remaining testing periods a restricted random assign- 
ment of tests to pupils was made. The restrictions were that no pupil 
get the same test twice and that the balance established during the 
initial testing period continue. For example, if 28 pupil'’ participated 
in the initial testing period then on each. subsequent period each of 
the twelve tests would be assigned to at least two pupils and four (28- 
24) randomly chosen tests would be taken three times. Hence, for a 
given class size, n, responding to the initial testing period, n - 12 
provides a quotient and remainder — the quotient determined the minumum 
number (m) of responses to each test and the remainder (r) determined 
how many tests are taken by one extra person. 

To accomplish the restricted random assignment, the following 
procedure was used: ^ 

1. Determine m and r. 

2. Use (m + 1) X 12 playing cards numbered 1-12 repeatedly as a 
model for assigning tests to pupils. 

3. Shuffle the cards thoroughly, cut the deck and note the number 



on the top card. Compare this with the test number taken by 
the first person at T^. If the number is the same, put the 
card at the bottom of the deck and look at the number on the 
next card, repeating the above process. If the number is 
different, then record this number as his assigned test for 
Record a tally for this test. 

4. After the first person is assigned a test continue, without 
shuffling to determine the test the second person should take. 
Each time a test is assigned record a tally. When r tests have 
been assigned to one extra person then allow only the minimum 
number of responses from this point on. Any number that can 
not be used when it comes up always goes to the bottom of the 
deck. 

5. After assigning tests for T 2 shuffle the entire deck thorough- 
ly and repeat the above process for and finally, for T^. 

When assigning tests for care must be taken to avoid dup- 
licating a test taken at or T 2 . must also be considered 
when tests are assigned to T^. 

The only conflict that can arise in this procedure is that near the 
bottom of the class list one might not have any possible "legal" assign- 
ment. For example, to satisfy the restriction that each test gets taken 
the minimum number of times it might be necessary to assign Test 3 to 
the last person. However, suppose Test 3 was taken by this person at 
T^l To escape this dilemma a random exchange was made with a test 
assigned earlier on the list. 

From the above discussion it is clear that once the original class 
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list was maclft and the test taken at Ti recorded, assignment of tests 
to pupils could be made for the remaining three testing periods. In 
November of 1968 all pupils were assigned tests for the remaining three 
periods. Thus, the future testing sequence for each pupil was known 

I 

shortly after the first set of testing materials had been returned. In 
some cases this sequence was never used as three classes dropped out of 
the study and some pupils transferred out of a given class. New pupils 
appearing in classes at T 2 were included in the data analysis, but 
following T 2 no new pupils were included in the analysis that did not 
participate at Ti or T 2 . 

Chapter V discusses criterion referencing as it was used in this 
s tudy . 
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CHAPTER V 

CRITERION REFERENCING THE ITEMS 



Criterion referencing as discussed in Chapter II applied mainly 
to individuals. In order to make decisions about individuals it is 
reasonable to set a specific mastery level score (criterion score). 
However, to use criterion referencing in a formative evaluation it is 
reasonable to modify the single score criterion established for a set 
of items. The formative evaluasuor is interested in item profiles and 
performance within the various content areas rather than the total 
test score. The total test score, although an indicator of growth, 
does not pinpoint where the growth has occurred. While it would be 
difficult to set a criterion level for each item, it is reasonable to 
classify items and to set A lower -bound criterion for each classifica- 
tion. Items used in the formative e^/aluatio^ of PIA-6 were classified 
in one of five types. (Romberg, 1969) 

(1) Mastery Level 1 X'A) : Items in this category are expected 

to be very easy by the end of the year. Most every pupil 

should have mastered the content of the item. 

</• 

An example of an A-Level item is given in Figure 3. 

Write "four and twenty -seven hundredths" as a decimal. 

Figure 3. Sample A-Level Item 
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(2) Mastery Level 2 (B): These items represent topics which 

receive major emphasis during the year. While items in 
this category test important objectives, a very high level 
of mastery is not expected. The majority of PIA-6 items 
fall in this category. 

An example of a B-Level item is given in Figure 4. 



Which number below is nearest to zero on the number line? 



a) i b) i c) I d) 



16 



Figure 4. Sample B-Level Item 



(3) Mastery Level 3 (C): Items in this category represent more 

complicated aspects of content covered in PIA-r6. C-Level 
items do not test extensions of concepts presented in PIA-6. 
Story problems which lead to involved computations as well 
as problems which are conceptually difficult for the average 
pupil are C-Level items. 

Ah example of a C-Level item is given in Figure 5. 




ABC 



Imagine 3 sacks that contain marbles as above. 

Sack A contains 1 white and 1 red marble 

Sack B contains 3 white and 3 red marbles 

Sack C contains 1 white and 2 red marbles 

If you reach in a sack and pick a marble without looking, 

which sack would the probability of a red marble be the 
greatest? 

a) Sack A b) Sack B c) Sack C d) It makes no 

difference 

T 

Figure 5. Sample C~Level Item 
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(4) Transfer Level 1 (X): Transfer Level 1 items involve a 

minor extension of concepts presented in PIA-u. The intro 
ductioh of new notation or a problem which requires some 
insight belongs in the X category. 

An example of a X-Level item is given in Figure 6. 



Which number below is between ^ and 1? 









b 


a) i 


1 

+ 3 


b) f+1 


c) l-l-T d) 0.30-1-0.20 
o / 






Figure 6. 


Sample X-Level Item 
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(5) Transfer Level 2 (Y): These items are the more difficult 

ones used in the testing. Such items are usually concep- 
tually difficult, represent an extension of program content, 
and contain difficult computations. 

An example of a Y-Level item is given in Figure 7 . 



A triangle n inches on a side has a perimeter of 60.3 
inches. What is the perimeter of a triangle n + 2 inches 
on a side? 



Figure 7. Sample Y-Level Item 
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Before these classifications can be used to interpret results 
they must be quantified. Quantification of each classification con- 
sisted of placing a lower -bound criterion on the item difficulty (per- 
cent responding correctly). This lower-bound criterion reflected the 
aspirations of the PIA staff for performance at the end of Grade 6. 
Table 4 indicates the lower-bound criterion for item difficulties for 
each classification level. Multiple-choice and free response items 
are considered separately since the former type involves an element of 



chance. 



TABLE 4 



LOWER -BOUND CRITERION FOR EACH 
CLASSIFICATION LEVEL 



Level 


Lower -Bound 


Multiple 

Choice 


Free 

Response 


A 


85 


80 


' 

B 


65 


60 


C 


40 


30 


X 


60 


50 


Y 


35 


10 



For example, a multiple-choice item which is classified level E 
has a lower-bound criterion of 65. If at the end of PIA-6, 73% of the 
pupils respond correctly to this item., then criterion is met. On.. the 
other hand, if only 32% respond correctly, a serious problem may exist 
and revision might be in order. Classification of items in this way 
makes it possible to objectively interpret the test results in terms 
of expected behaviors and use these results to suggest modifications. 
Another objective met by this system is that the goals of the curric- 
ulum developer are conveyed to the reader. 

Table 5 shows how the items used in this study were classified 
(Items 1-8 on Test 4 were not classified). Two staff members worked 
together to classify each item. There was disagreement. It was often 
difficult to decide whether an item should be level B or level X. 

Level B is the intermediate mastery level and level X represents a 
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minor extension. Figure 2, Chapter III, illustrates how the classifi- 
cation was used for item 14 on Test 11 (an A-Level, free response 
item). The horizontal line at 80% indicates criterion for this level 
item, A graph similar to that in Figure 2 is located beside each 
classified item in Appendix B. 

Although the criterion referencing of items is useful and infor- 
mative, it is nevertheless arbitrary. An item may not reach criterion 
for several reasons : 

1. The item was measuring a skill other than the one intended. 

2. Poor instruction. 

3. Coverage related to the item was not as originally planned. 

If items are chosen before detailed planning, it is possible 
that some topics will not get the intended treatment. Items 
related to sudh topics will naturally be more difficult than 
anticipated. 

4. Criterion was set too high. 

5. The estimate of item difficulty is subject to sampling error. 
Some of the same reasons may also explain why an item reaches criterion. 
In particular, (1) and (5) could be responsible for some items reach- 
ing criterion. 

In summary, a ci.’iterion level is an arbitrary level assigned by 

V 

the developmental staff that reflects their aspirations — it should 
not be considered as absolute. 
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TABLE 5 

CLASSIFICATION OF ITEMS FOR TESTS 1-12 



Item 



Test Test Test Test Test Test Test Test Test 7’est Test Test 
1 2 3 4 5 6 7 8 9 10 11 3.2 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 



11 

12 

13 

14 

15 

16 

17 

18 

19 

20 



A 

A 

B 

A 

B 

X 

X 

A 

B 

A 



A 

A 

X 

A 

B 

B 

B 

A 

B 

A 



A 

B 

Y 

A 

B 

X 

B 

X 

B 

A 



B 

X 

C 

A 

B 

B 

B 

B 

C 

X 



A 

B 

B 

X 

X 

X 

A 

A 

X 

B 



Y 

B 

A 

A 

A 

B 

B 

B 

B 

B 



A 

A 



X 

B 

A 

B 

B 

B 

A 

B 

A 

A 



A 

B 

B 

B 

B 

X 

A 

B 

B 

X 



B 

Y 

A 

A 

B 

B 

B 

C 

B 

A 



A 

X 

X 

B 

B 

B 

B 

B 

B 

B 



X 

B 

X 

B 

B 

B 

A 

B 

B 

Y 



A 

X 

B 

A 

B 

C 

A 

B 

B 

B 



X 

B 

B 

A 

B 

A 

B 

B 

B 

C 



A 

A 

X 

B 

A 

X 

C 

X 

X 

A 



Y 

B 

B 

B 

B 

A 

B 

A 

B 

C 



A 

B 

C 

B 

B 

B 

X 

B 

B 

Y 



X 

X 

B 

A 

B 

A 

A 

C 

B 

B 



A 

B 

A 

B 

B 

B 

C 

X 

X 

Y 



C 

B 

B 

A 

B 

B 

B 

B 

B 

C 



A 

B 



B 

C 

Y 
B 
C 

Y 



C 

B 

X 

A 

B 

A 

B 

C 

B 

Y 



B 

X 

Y 
X 
B 
B 
X 
A 
X 

Y 



A 

C 

X 

A 

B 

A 

B 

B 

C 

Y 
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CHAPTER VI 



THE DATA 

Item Data and Test Characteristic s 

A copy of each test Is located In Appendix B. Typically, every 
test was taken by two or three pupils in each class at each testing 
period* The common set of instructions for accomplishing each admin- 
istration is also located in Appendix B. 

For item-sampling to function properly pupils must have a chance 
to respond to each item. Therefore, no rigid time limit was imposed. 
Since it is well known that there are pupils who will work "forever" 
on a test if given the opportunity, a conservative, maximum time limit 
of 35 minutes was suggested. The teacher could, of course, take the 
tests up before 35 minutes. Table 6 summarizes the modal adminis- 
tration date (in terms of programs 1-64) and the average time re- 
quired for a class to complete the tests (exclusive of distribution 
of materials and the reading of directions). From this table it is 
clear that 35 minutes was a conservative time limit. 



TABLE 6 

LOCATION AND TIME REQUIRED FOR TESTING FOR T^-T^ 



Testing Period 


Program Location of Testing 


Average Classtime Required 




Between Programs 5 and 6 


23.8 minutes 


^2 


Between Programs 20 and 21 


24.8 minutes 


^3 


Between Programs 41 and 42 


23. 9 minutes 


■^4 


Between Programs 63 and 64 


23.8 minutes 



50 



The twelve, 20-item tests were administered four times during 
the 1968-69 school year. They were administered in September, 
November, February, and May. Patterns In Arithmetic-6 has 64 dis“ 
tinct programs. The testing periods occurred at Program 5 (T^^) , 
Program 20 (T^) , Program 41 (T^) , and Program 63 (T^) . In order 
to explain wfiat happens at a given testing period, it is necessary 
to know the specific content covered prior to vhat testing period. 
For example, to interpret test results at T^ it is necessary to know 
that between T^ and T^ Programs 6-20 were viewed. The effect of the 
TV programs and related pupil exercises can then be measured by 
observing pupil performance on related items. Also, the effective- 
ness of review exercises in maintaining and improving skills and 
% 

understanding can likewise be measured. 



This chapter will present the item data and test characteristics 
at each of the four testing periods. The information reported for a 
given testing period is as follows: 

1) Item data (reported in percent responding correctly) 

will be reported for three groups: a group which 

participated in PIA-5 (Y-Group) ; a group which did 
not participate in PIA-5 (N-Group) ; and a combined 
group (C-Group) consisting of those pupils in each 
of the first two groups and any pupils that could 
not be classified as Y-Group or N-Group. The group 
distinction made it possible to measure the cumulative 
effect of PIA. However, the small size of the N-Group 
makes it impossible to make strong generalizations. 

2) The number (N) of pupils taking each test for each of 
the three groups. 

3) The test mean (MEAN) , standard deviation (STDEV) , and 
reliability (R) for each. test and for each of the 
three groups. 

4) The item correlations between the Y-Group and N-Group, 

for each of the twelve tests. For a given test 

a high correlation between item performance could imply 
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that the Y~Groiip and N"Group are operating from 
a fairly common base with respect to the concepts 
and skills being measured by the test. A low 
correlation between item performance could imply 
that one group was operating differently with 
respect to some content measured by the test. 

For example, if a test item involved terminology 
or concepts common to PIA but foreign to those 
pupils using other arithmetic programs, then 
performance by the PIA group would likely be 
considerably above that of the other group. 

This would tend to lower the correlation between 
item performance. 




the September testing period. The data for is presented in 

Appendix C. 

Beside each test item in Appendix B is a small graph. This 
graph represents a growth profile for the item across the year. 

Figure 2, Chapter III, illustrates the appearance of a sample pro- 
file. The four testing periods are plotted along the horizontal axis 
and the corresponding percents responding correctly are plotted along 
the vertical axis. These graphs are based upon data reported in 
this chapter and Appendix C for the C-Group described above. 

Data Presented by Content Area 

The last section presented an overall picture of how the tests 
functioned at each testing period. Since each test represents quite 
varied coverage, it was necessary to assemble the items by content 
area in order to interpret results. This chapter considers each 
major topic covered in PIA-6. After reading the concluding chapters 
it should be clear that the data reported herein represents per- 
formance on materials written during the developmental year. Modi- 
fications on the "first generation" PIA-6 materials based upon the 
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formative evaluatiop should strengthen those areas which appeared 
weak. 



For each topic all related items were retrieved from the twelve 
tests. For example, all items related to fractions were grouped 
together. Frequently an additional break Jown was made, especially 
for the more significant topics like fractions, decimals, and 
geometry. The data for each topic is presented according to the 
following format: 

1. The ma,ior topic (/.ontent area) is identified (e.g.. 
Fractions) . 

2. Subtopics within the major topic area are identified 
where necessary (e.g.. Addition and Subtraction 

of Fractions). 

3. The location of the item and a summary of its content 
is indicated. The item location is indicated by a 
number pair such as (3, 16) which indicates Test 3, 

Item 16. The content summary is often very abbreviated 
and it may be necessary to refer to the specific item 
in Appendix B. 

4. Results are reported at each testing period for the 
Y-Group (the group using PIA-5) and the N-Group 
(the group not using PIA-5) . 

5. A code is used between testing periods so indicate 
how PIA-6 coverage related to the item: 

a) A indicates major attention was given 
to the content tested by the item. 

b) An "r" indicates significant review related 
to the item appeared. 

c) A "c" indicates that coverage related to the 
item appeared.. However, items having this 
code often require several skills, some of 
which may not have been covered. 




How to Interpret Topic Data 
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The first major topic presented is that of fractions (see 
Table 8) . The first item involves addition of fractions with unequal 
denominators. The item can be found on Test 1, Item 15. For the 
Y-Group, 33 per cent responded correctly at and 51 per cent res- 
ponded correctly at T^. The * between T^^ and T,^ indicates that this 
skill received major attention between T^ and (Programs 6-20) . 

If one would like to know how many pupils responded to this item. 

Table 7 indicates that 89 pupils in the Y-Group responded at T^. 

The 89 responses represent random responses from approximately 45 
different classes. This is true in general for the Y-Group: the 

number responding to a given test (item) represent a random sample 
of pupils from approximately 45 classes that had previously used 
PIA-5. The number responding in the N-Group represent a random 
sample of pupils from approximately 15 classes that had previously 
used an arithmetic program in grade 5 other than PTA-5. A word of 
caution — since only about 30 pupils belong to the N-Group, the 
item data for this group must be interpreted with care. 

The data for the topic "Fractions" is presented in this chapter. 
The following topics are presented in a similar fashion in Appendix C: 
Decimals, Ratio, Geometry-Measurement, Geometry — Non-Metric, Integers, 
Long Division, Sentence, Number Line, Relation and Functions, Charts 
and Graphs, and Probability. Some items were appropriately classified 
in more than one category. 




TABLE 8: RESULTS BY CONTENT AREA: FRACTIONS 
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CHAPTER VII 



USE OF THE RESULTS 



For Revision and Review 

The data presented in Chapter VI and Appendix C was for each 
testing period and several content areas. This data was used to 
plot a graph which shows a growth profile across the school year for 
every test item. These graphs are located in Appendix B adjacent to 
the corresponding test item. The data by content area and the growth 
graphs present a comprehensive picture of what happened to important 
concepts presented in PIA-6. 

Although the graph plots were not available until the final test- 
ing (T^) was completed, the data by content area reported in Chapter VI 
was updated at each testing period and made available to PIA staff. 
Typically, a meeting was held a few days after a testing period and the 
results of the testing were reviewed and interpreted. Items related 
to topics covered by intervening programs were the focus of discussion. 
Skills and concepts which had been covered earlier in the year were 
also examined to see how well they were being retained. The problem 
writer for the Pupil Manual was present at these meetings and received 
suggestions for topics which should be reviewed and exercises that 
could be revised. All members of the PIA staff proposed or submitted 
problems for the Pupil Manual. In particular, the evaluator and the 

problem writer discussed the pupil exercises for most programs. A 
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rather persistent question asked by the problem writer was "What 
kind of review exercises do you think are appropriate here?" 

Significant results of the testing undoubtedly functioned in 
subtle ways that were not always observable. It is, however, 
appropriate to discuss observable ways the test data was used to 
develop and modify the materials. 

Major Revision 

The single most important result of the testing involved Programs 
15 and 54. These two programs reviewed and extended decimal numer- 
ation and density. Both programs, particularly Program 54, provided 
instruction and exercises on ordering decimls. One of the primary 
objectives of these programs was to teach pupils how to order decimals 
such as .238, .24, .3, and .05 (e.g., .05 < .238 < .24 <.3). Test 9, 

item 4, was designed to test a skill necessary before decimals can be 
ordered effectively (see Figure 8). 



Which number is the greatest? 



a) 


0.03 


b) 


0.29 


c) 


0.293 


d) 


0.2093 



Test 9, Item 4 
Figure 8 

The response pattern to this problem V7as as follows — T^^: k% correct; 

T : 87o correct; T_: 97o correct; T, : 467o correct. A look at the re- 
2 3 ^ 

sponse pattern at T^y T^j and T^ revealed that the 907.+ pupils who 
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responded incorrectly were about equally divided among the three 
distractors - 0.03, 0.29, and 0.2093. Three hypotheses relating to 
misconceptions pupils have about decimals were offered to account for 
these results. 

1) The group choosing 0.03 focused on its non-zero digit, 3 
being larger than the digit 2 which is the first non-zero 
digit in the other choices (the fact that the 3 is in the 
hundredths place is overlooked). 

2) The group choosing 0.29 did so because they knew that one- 
thousandth < one-hundredth and then generalize incorrectly 
that thousandths are less than hundredths — hence, the 
incorrect conclusion: 0.293 < 0.29. 

3) The group choosing 0.2093 focused on the number of digits 
rather than appropriate place value. Since 0.2093 is a 
"longer number" than the other choices, then it must be 
the greatest. 



Program 54 was completely reworked as a result of the testing. While 
it was too late to make changes in the Program 54 tape for develop-' 
mental year use, the Teacher Notes were modified considerably to 
alert teachers to the three misconceptions pupils have about decimals. 
These misconceptions along with recommendations for aleviating them 
were detailed in the Teacher Notes. That these recommendations were 
of value can be seen by comparing the results at T^ with those from 
Tf - T^. The TV tape for Program 54 was redone with particular 
emphasis on ordering. 

The effect of this redo could not, of course, be measured duiring 
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the developmen, al year. Program 15 emphasized a verbal approach to 
ordering — it was thought that if pupils could read decimals, then 
they could compare them. While this program was effective in teaching 
pupils how to read and write decimals (see Test 4, items 13 and 20; 
Test 11, item 16), it was not effective in teaching order. There- 
fore, the redo of Program 54 approached order using a scanning process 
often a digit by digit comparison. For example, to compare 63.816 
and 63.82 one observes that corresponding digits are the same until 
you reach the hundredths digits. Then, since two hundredths is 
greater than one hundredth, it follows that 63.82 > 63.816. Counter 
examples to the misconceptions pupils have about decimals were used 
on the program. 

Other Revision Suggested by the Testing 

1^ Another weak area uncovered by the testing was measurement. In 
particular, perimeter, area (of a rectangular region) and volume 
(of a box) were all covered prior to T^. However, results on the 
testing clearly indicated that perimeter and area were often confused 
and what was done with the specified dimensions on a volume problem 
bordered on randomness. Specific review exercises were designed to 
distinguish perimeter and area. Also, volume was explored in greater 
detail on a later program and review exercises were included. From 
the test results (see Table 9) it can be seen that these aspects of 
measurement did show improvement following T.^. 

The problem of finding the area of a triangle was not easy at 
any time during the year (see Table 9, item 7). The formulas for 
the area of a parallelogram and area of a triangle were introduced 
in a single program - Program 30. It is possible that one program 
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TABLE 9 

TEST RESULTS FOR 3 PERIMETER ITEMS, 4 AREA ITEMS 

AND 1 VOLUME ITEM 



C “Group 



1 . 



Item 



What is the distance around 
the rectangle below? 



Percent Correct 




73 71 68 80 



Mastery 

Level 



A 



1 



7 



a) 7 

b) 8 

c) 14 

d) 16 



6 inches 



2. The large square above has 
been divided into four small 
squares. What is the 
perimeter of a small square? 



28 32 43 51 



X 



3. 



a ) 3 inches 

b ) 6 inches 

c ) 12 inches 

d) 24 inches 



A square is nine inches on a 
side. What is its perimeter? 



60 



56 



70 



64 



A 



a) 9x9 

b) 9 + 9 

c) 4x9 

d) 2x9 



i 
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TABLE 9 (Continued) 



I 



C -Group 

Percent Correct 



Item 



Mastery 

Level 



If the area of the rectangle 
above is 18, what is the area 
of the shaded part? 



a) 



18 .i 



8) i 

c) 3 

d) 6 




What is the area of a rectangle 
8 feet long and 3 feet wide? 

a) 11 sq. ft. 

b) 22 sq. ft. 

c) 12 sq. ft. 

d) 24 sq. ft. 




If ABCD is a rectangle, what 
is the area of the entire 
figure (the rectangle and 



the 


triangle)? 


a) 


116 


b) 


480 


c) 


136 


d) 


25 



52 52 60 65 



60 72 85 79 



30 20 31 47 



I o 

I me 
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TABLE 9 (Continued) 

C -Group 

Percent Correct Mastery 



Item T^ T^ T^ T^ Level 




was not sufficient for the concepts presented. 

The basic approach to area in PIA was in terms of "inner" and 
"outer'* area of a closed curve. It was realized in PIA-5 that the 
term "outer area" was very confusing and was in fact a misnomer for 
many pupils. The outer area was naturally associated with the grid 
squares located "outside" the given closed curve. An attempt was 
made in PIA-6 to review outer area (Program 3) and make teachers 
aware of the problem pupils have with this concept. Test 10, item 5, 
pictured a grid o\rer a circle and asked for the outer area of the 
circle. Performance on this item at T^ showed a sizeable gain over 
results on a similar problem given at the end of PIA-5. However, 
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in the absence of significant review the concept showed considerable 
decay over the year (see Figure 9). 



Test 10, Item 5 




Growth Profile for 
Test 10, Item 5 



a ^ * 

100%n 



50 




I r 

Ti 









T — r 

T., 



In the figure above, use the grid 
to determine the outer area of the 
circle. What is the outer area of 
the circle? 



a) 16 

b) 28 

c) 36 

d) 64 



Test 10, Item 5 and Growth Profile 
Figure 9 

While PIA staff remain convinced that their basic approach to area 
was a sound one, it is clear that the term "outer area" was confusing 
for many 5th and 6th graders . 

Problem solving is a skill which one likes to think of as 
evolving, yet capable of being effected by the teacher and the 
curriculum. It is safe to say that most pupils in which problem solv- 
ing skill is manifest have developed this skill independently of both 

text-books and teachers. During the evaluation of PIA-6 it was 
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observed that two test problems were much alike; however, one was 
much easier than the other (see Figure 10). 



Test 5, Item 6 

If (E,F) represents the number 
of edges (E) and number of 
faces (F), what is (E,F) for 
a cube? 

a) (4,4) 

b) (6,12) 

c) (12,4) 

d) (12,6) 



Test 9, Item 12 




If E = number of EDGES 
F = number of FACES 
V = VOLUME 

What is (E,F,V) for the cube 
above? 



Test 5, 



a) (9,4,3) 

b) (12,6,1) 

c) (9,6,1) 

d) (12,4,3) 

Item 6 and Test 9, Item 12 
Figure 10 



The results at T^^ showed 13% responded correctly to item 6 (33% took 
choice b) while 57% responded correctly to item 12. These results 
suggested that the appearance of the visual for item 12 made it much 
easier than it would h%ve been otherwise. With the visual they could 
count edges and faces.. 

The question naturally arises "Why don't pupils construct a 
sketch if a sketch makes the problem so much easier?" Here, it 
seems, is a place where a problem solving skill, sketching, can be 
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taught — a skill which will b6 useful not only in arithmetic, but 
throughout one's mathematical career. At least two sections of 
exercises in PIA-6 were modified (Programs 31 and 60) to encourage 
pupils to sketch a figure for the problem. Also, a section (Program 8) 
involving cuts through solids was modified to have the pupils draw 
cuts to satisfy certain conditions rather than have all cuts predrawn. 
1^ Many test items (e.g.. Test 1, item 19; Test 8, item 17) involved 
long division. The PIA approach to long division was to introduce it 
in grade 4 in terms of repeated subtraction after having established 
that a -r b = n and a = n x B are equivalent sentences. The concept 
of repeated subtraction was used to solve sentences like n x 24 = 96 
before the division process was introduced. Having introduced long 
division by repeated subtraction in PIA-4, a series of refinements 
were made in PIA-5, but the traditional long division algorithm was 
not introduced until Program 17 of PIA-6. The basic reason behind 
the lengthy PIA approach to long division was to promote under- 
standing of the algorithm. While the repeated subtraction process 
is easy to understand it is often time-consuming. Moreover, when 
one encounters a problem like 236.2 v 0.65, it is desirable that the 
algorithm be used. Every long division problem involving counting 
numbers with a remainder was worked on the back of the pupil’s 
answer sheet. It was of interest to see what fraction of the pupils 
were using the algorithm introduced in Program 17 . At T 2 ^ check 
showed that approximately — of the pupils were still using the "old" 
repeated subtraction process. When this was discovered the Teacher 
Notes for Program 17 were revised to encourage a more complete shift 
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to the algorithm. The fact that many pupils were evidently more 
comfortable using the old method was not taken as a bad sign. On 
the contrary, it suggested that a certain group of pupils understood 
the repeated subtraction approach and found it more meaningful than 
the algorithm. By almost all pupils were using the standard 
algorithm. 

1^ The use of ratios in problem solving was one of the key mathe- 
matical ideas that permeated much of grade 6. Ratios were reviewed 
early in the year and used to convert from one standard unit of 
measure to another. Later in the year ratios were used in similar 
figures and scale drawings. The final application of ratio was to 
percent. A ratio approach to percent avoided the necessity of treat- 
ing percent problems as three distinct cases. In general, ratio 
was a strong area for PIA. From the items listed under ratio (see 
Appendix C) it is clear that there were many difficult problems in 
this area. Most items showed nice growth over the year and skills 
were maintained through repeated use of ratio to solve many types 
of problems. The power and flexibility of the ratio approach in 
problem solving was evidenced by one pupil’s approach to a problem 
that was not classified as a ratio problem. The problem was located 
at Test 12, item 20 (see Figure 11). 
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One cubic foot of water weighs 62.4 
pounds. How much does a column of 
water one inch square and one foot 
high weigh? Write £ sentence to 
show what must be done to get the 
answer. You do not have to find 
the answer. 



Test 12, Item 20 
Figure 11 



It was expected that the correct answer would be written in the form 

62.4 T 144 = n. However one 6th grade girl answered the problem with 
144 _ 1 

the sentence ^2~4 ” n* ^ valid and rather amazing application oE the 
idea of ratio by a 6th grader. 

^ One objective of the testing was to determine how computation 

skills changed over the year. It was necessary to review many skills 

covered in PIA-5 and several computation problems were devoted to 

these previously introduced skills. For example, problems like 
15 

^ ^ and 571 x 68 were introduced prior to PIA-6 but reviewed at 

various points in PIA-6. Most old skills were maintained at a high 
level. New computation skills that were introduced often showed 
dramatic growth on the testing period following coverage of the topic. 

The most obvious trouble spots in computation involved the multi- 
plication of two mixed numbers (e.g., 3 y x 2 and problems of 
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mixed types (e.g., 0.3 + The latter problem was given 

particular attention in the Pupil Exercises. Review exercises 
required pupils to add, subtract, multiply, and divide numbers 
written in a form unsuitable to operate upon directly. For example, 
0.3 + y would be changed 0.3 + 0.5 = 0.8. Early 

in the year many pupils were answering 7 j t 5 ao 1 with a remainder 
of 2 Although this is not an incorrect answer (if one views 
division as repeated subtraction), it is not a desirable one. T^ter 
in the year, after division of fractions was covered, the tendency 
to answer the problem this way greatly decreased. The response 
became 7jT5 = -Yv5 = -orl-. 

Program 62 reviewed problem solving and more specialized sentence 
forms. The reason for reviewing these sentences was that pupils had 
developed additional computation skills and a program was needed to 
tie together the newly acquired skills and familiar sentence forms. 

One sentence introduced on the TV program was 

F = 500 - (6.2 X 35). 

Here it is necessary to find the product first and then subtract this 
from 500 to obtain F. Problem 18 on Test 7 was similar to this 
problem. The pupil had to compute 

1088 + (38 X 1.1) = ? 



The main difference between this problem and the one used on the TV 
program is the operation — subtraction on the TV problem and addition 
on the test problem. PIA staff expected to see a nice gain on this 
problem at T^ since Program 62 occurred near the fourth testing 
period. At T^ 15% of the group responded correctly while at T^ 20%, 



responded correctly. This result was surprising and disappointing. 



To get some insight into the difficulty students had with this 
problem, the answer sheets were carefully analyzed. The correct 
answer to the problem 1088 + (38 x 1.1) = ? is 1129.8. However, 
33 of 92 responses in the Y-Group were 150.61 The students were 
doing the following: 



They did not locate the decimal point on the intermediate product 
and the digits for the sum were misaligned. 

For Program Planning 

Administration of the entire pool of 240 items at four times not 

only made it possible to evaluate the effectiveness of the curriculum, 

but it also indicated how students attack certain problems and what 

correct and incorrect “hunches" they have before instruction is given. 

4 9 

For example, it was found that before instruction the problem x ^ 

was answered correctly by 237o of the pupils. 

Another problem of interest was 0.2 x 0.6 = ? Students had no 

specific instruction in multiplying by decimals until Program 35. 

However, Program 15 covered decimal numeration and Program 20 covered 

multiplication of fractions. By T^ the problem could have been worked 

2 3 6 

as 0.2 X 0.3 = Yo*Yo~ ~ 0.06. At T^ 67, responded correctly 
while at T^ 187, responded correctly. This indicated that a few 
students were able to synthesize the instruction from Programs 15 and 
20. Another interesting aspect of this problem was the number of 
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11 

38‘ 



1088 
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students who responded 0,2 x 0,3 = 0.61 At 88 students out of 

127 made the free response 0.6. At T^, after instruction in how to 

multiply decimals, 62 out of 128 still responded 0,6. 

Probability is not a traditional topic in the elementary school. 

PIA-6 introduced probability late in the school year (Programs 56-57). 

Eleven problems in the item pool were related to probability. Since 

occurred at Program 41 three measures on the difficulty of these 

items were available to assist in the planning of the programs on 

probability. It was found fhat the terms "m6st likely", "least 

likely", and "equally likely" were understood by most pupils. A 

spinner problem was quite easy and suggested that spinners could be 

used as an aid to teach probability. Although pupils were aware of 

certain informal aspects of probability, they did not know how to 

assign a number to represent the probability of an event. For 

example. Test 6, item 18, referred to a sack that contained 4 BLACK, 

and 7 RED balxS, The pupil was required to state the probability 

of drawing a FEB ball. The response pattern was as follows: 

T, : 37o correct; T«: 5% correct; T_: 9% correct and T, : 617o correct, 
12 3 4 

I’l, and T^ represent pre<>instruction knowledge. Clearly, one 
had to assume tJ.ie pupils knew nothing about assigning probabilities. 
Another skill that pupils m?ast master before more involved prob- 
ability problems can be solved is that of the "product rule" for 
determining the number of outcomes to an experiment. Test 20, item 9 
showed several pupils could already appl}’’ this rule to a simple 
case. However, a significant number of pupils were adding rather 




than multiplying. 
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Another topic about which pupils knew a surprising amount before 
instruction was reading graphs and charts. In fact, the pupils knew 
so much about this topic that little gain was evidenced across the 
year on most of the items. Rather then devote the pupil exercises 
to retrieving data from graphs and charts, pupils were required to 
graph data (given a chart) and to make a chart and graph from raw 
data. 

Weaknesses in the Item Pool 

Evaluating a curriculum using item sampling with a pool of items 
conceived before the curriculum is finalized has two main disadvantages. 

1. Irrelevant items may be included in the item pool, and 

2. Not all important aspects of the curriculum may be 

covered by the item pool. ^ 

For the evaluation of PIA-6 the latter event was more common than 
the former. The following are important aspects of PIA-6 which were 
not adequately tested by the item pool: 

1. Angle Measure (Programs 18-19): Use of the protractor; 

angles between parallel lines when intersected by a 
diagonal; terminology associated with angles; the 
proper way to name an angle. 

2. Coordinate Geometry (Programs 38, 40): Locating 

integers on the number line; representing "trips" 
on the number line using vectors; locating ordered 
pairs of integers In a coordinate system. 

3. Inequalities (Programs 37, 39): Graphing inequality 

sentences; equivalent inequality sentences. 



4. Similar figures (Programs 51-53): Meaning of similar 

figures; projections and special cuts of solids which 

yield similar figures; dilations. 

a 

5. Fractions: The equivalence of ~ and a t b; use of the 

term reciprocal; converting a fraction to a mixed 
number using long division. 

6. Reflections (Programs 24-25): Finding the image of a 

given figure; locating the line of reflection when 

the figure and image are given; properties of reflected 
f igiires . 

The formative evaluation would have been lacking without some eval- 
uation on the aspects mentioned above. Therefore, quarterly Check-Up 
Tests were sent to teachers to serve the dual purpose of classroom 
evaluation and formative evaluation of topics not adequately covered 
by the item pool. The teachers using PIA-6 had expressed the need 
for a test that they could use. The twelve, 20-item tests could not 
be used effectively for classroom evaluation because each class took 
a?l tests. Kcreover, prior to T^, some of the test items represented 
topics that were yet to be presented. 

Each Check-Up Test contained about 30 items and covered areas 
of interest to teachers and particularly the neglected areas listed 
above. Teachers were not requested to return these tests and admin- 
istration was optional — cooperation over four testing periods was all 
that could be expected. Notes relating to the Check-Up Tests 
expressed the desire on our part to get feedback on these tests. 
Typically, about 10 classes returned the tests at each quarter and 
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about half of these were rescored by PIA staff. These tests seemed 

to be popular and useful for the teacher. 

The four Check-Up Tests were modified for inclusion in the Pupil 
Manual for PIA-6. Check-Up 2, Check-Up 3, and Check-Up 4 were simply 
retyped using a slightly different format and more effective art. 
Check-Up 1 was not very satisfactory for classroom evaluation and was 
modified. The Check-Up Tests and summary statistics are included in 
Appendix D. Problems not included on the original Check-Up 1 are 
indicated. No summary statistics are available for Check-Up 1 and 
Check-Up 4, 
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CHAPTER VIII 



CONCLUSIONS 

The purpose of this study was to explore the use of item- samp ling 
in formative curriculum evaluation, A pool of items was conceived that 
represented content to be covered and skills to be mastered by a sixth 
grade TV arithmetic program, Patterns In Arithmetic. Items were selected 
from the pool to fit twelve, 20-item tests. These tests were administered 
four times during the 1968-69 school year to the population participa- 
ting in the study. Results from the testing periods were used for 
program planning, to suggest appropriate review, and to indicate major 
revision. The previous chapter gives, examples of these aspects. 

It is clear that the use of item-sampling in formative curriculum 
development makes planning and revision more systematic than traditional 
testing procedures. It is possible to monitor simultaneously many di- 
mensions of the curriculum. Moreover, the item profile provides a 
"history" of the item across the year. If effective revisions are made, 
the developmental year "history" is but a temporary state. The revised 
version should prove superior to the developmental year product. 

It is appropriate to discuss some of the practical decisions one 
faces when item-sampling is used in curriculum development. 
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Item St«ibtllty and die Population 

In Chapter III the problem of obtaining a stable estimate of item 
difficulty was discussed. Data was presented for four items (see 
Table 2) that appeared on two different tests. It was found that 120- 
130 responses generated under item-sanq>ling conditions produced a fairly 
stable estimate of item difficulty. However, 30-40 responses generated 
und^r similar conditions produced less reliable (more variable) estimates. 

Although desirable, it is not necessary to have extremely precise 
estimates of the "true" difficulty of the items for purposes of forma- 
tive curriculum evaluation. The study group itself is but an "estimate" 
of the larger target population of potential users. Moreover, one is 
normally not trying to compare groups using a statistical test of sig- 
nificance. The formative evaluator monitors the developmental year 
product and signals its successes and failures. Hence, the estimates 
of item difficulties provided by item-sampling must only be accurate 
enough to expose weaknesses within the curriculum. It is the joint duty 
of the evaluator and the curriculum developer to decide upon how ac- 
curate the estimates must be. Table 10 indicates the standard error 
(S.E.) of the estimate for several sample sizes, N, and true item dif- 
ficulties, p. This table assumes the binomial model and uses the 
formula: 




(q = 1 - p) 



S.E. 
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TABLE 10 

STANDARD ERROR OF THE ESTIMATE 



q 




30 


60 


90 


120 


150 


180 


210 


.9 


.1 


.055 


.039 


.032 


.027 


.024 


.022 


.021 


.8 


.2 


.073 


.052 


.042 


.037 


.033 


.030 


.028 


.7 


.3 


.084 


.059 


.048 


.042 


.037 


.034 


.032 


.6 


.4 


.089 


.063 


.052 


.045 


.040 


.037 


.033 


.5 


.5 


.091 


.065 


.053 


.046 


.041 


.037 


.034 



The binomial model is appropriate under conditions of item- samp ling. 
This can be seen by considering the probability of a given individual 
responding correctly to an item. For a fixed population and a given 
item there exists a number p which corresponds to the fraction who "know" 
the correct answer to the problem. If an individual is selected at ran- 
dom from the population then the _a priori probability that he will respond 
correctly is p. If a sample of N individuals is selected from the popula- 
tion to respond to the item then it is clear that the probability of k 
correct responses is: 

N k N-k 

) P q > the ( k + l)st term in the expansion of the 
binomial (q + p)^. 

It is well known that as N gets larger, the binomial distribution 
approaches the normal distribution. The parameters fi and <r® for the 
normal are p and Npq respectively for the binomial. While Npq represents 
the variance of the number of successes (correct responses), the standard 
error is more frequently reported. For a given N and p the standard er- 
ror function tells how likely it is that a fixed interval centered at 
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p will contain the observed value of p, namely p. The fact that the 
distribution of p rapidly approaches the nrrmal distribution with mean 
p and variance ^ makes it possible to use a table for the normal dis- 
tribution to express what fraction of the time a given interval will 
contain p. 

Using the normal approximation, the interval p + S.E. will cover 
p about 68% of the time while p + 2 S.E. will cover p about 957^ of the 
time. Table 10 shows that for 90 random responses to an item with true 
difficulty p = .4, the standard error of the estimates is .051. This 
means that if a random sample of size 90 responded to the item and an 
estimate, p, of the true item difficulty was calculated, then the in- 

I 

terval .4 + 0.051 (.349 to .451) would contain p about 68% of the time. 

In practice one does not know p and is trying to obtain a useful 
estimate of p. Therefore, while in theory one can speak of the likeli- 
hood that p + S.E. contains p, in practice one does not know p. What 
is generally done is to treat p like p and use a standard error that 
is only approximately correct. For example, suppose p = .30 and true 
(but unknown) p = .35. If p is based upon 120 responses then the table 
value .041 is used as an approximation to the standard error. 

An interesting observation can be made from Table 10 by comparing 
the columns for N = 30, 120, and 210. The standard error of the N = 

120 column is about one half that of corresponding entries in the N = 

30 column. The increase of 90 responses doubles the accuracy of the 
estimate. However, suppose 90 more responses are obtained making a 
total of 210 responses. It is clear that while the standard error 
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decreases, the accuracy is only slightly improved. Thus, even though 
210 responses clearly provides a more stable estimate of item difficulty 
than 120 responses, it does not provide the formative evaluator with 
substantially more decision-making capability. Since the standard er- 
ror is calculated using the formula it is clear that for fixed p 

the standard error varies as^^^ Hence, one must multiply his sample 
size by 4 to cut the standard error in half. For the above example 480 
random responses would be needed to cut in half the error for 120 re- 
sponses. 

The evaluator must not take every slight drop in item performance 
as a definite sign that review is needed — he must be aware that chance 
variation will occur. One hundred twenty responses are certainly enough 
to alert the evaluator to a serious problem. However, to determine if 
a topic needs review it may be necessary to group several items related 
to the concept or skill. A slight variation in a single item might be 
a chance result. 

The following factors should be considered in determining N: 

1) The size of the population that is to be sampled 

2) The number of *!.tems about which one desires to get information 

3) The desired accuracy of the estimates 

4) The amount of time that is available for testing. 

The following example illustrates how these factors operate together. 

Suppose a study involving item-sampling is being planned and it is 
estimated that 1,300 pupils will be participating in the study. These 
1,300 pupils probably represent a larger target population. The evaluator 
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and the developer agree that for middle-difficulty items a standard er- 

J 

ror of .04 is sufficiently small for making developmental decisions. 
From Table 10, 150 random responses to an item are necessary to prov' 
this accuracy. The integer part of the quotient 1300 • 150 is 8. 
Therefore, the evaluator can use 8 different tests to obtain informa- 
tion. It was indicated earlier that for administrative efficiency the 
tests should be approximately the same length and suitable for admin- 
istration under uniform instructions. Once the number of tests is 



decided upon the next decision is how many items per test are reasonable. 
If there are 400 items one would like information about, then 400 * 8 
50 items per test may be used. However, 50 items per test may be un- 
reasonable in terms of the time required. This would be particularly 
true if the tests were to be administered several times. Therefore, 
a compromise must be met. The evaluator could increase the size of 
the population, decrease the number of items, or do both. For a given 
study it is likely that many workable combinations will exist. The 
various combinations should be given careful consideration well in ad- 
vance of the study. 

Selection of the Item Pool 

The success of any evaluation depends upon the quality of the items 
about which one gathers information. There is no conceivable way for 
poorly chosen items to provide useful results. One of the primary ad- 
vantages of item-sampling over traditional standardized achievement 
testing is that the evaluator can hand-pick the items. Therefore, much 
thought and effort should go into building an item pool that contains 
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only informative items relative to the objectives of the curriculum 
being evaluated. If one of the objectives of the curriculum is to 
promote a "positive attitude" toward a subject, then items designed to 
measure attitudes are certainly "informative" items. The present study 
wou3d have been more effective if the evaluator had looked at each item 
in the pool and asked the question "Is this item worth being responded 
to?" The result would have been to toss out about 20 items that were 
included in the final item pool. 

Multiple-choice items should be chosen that have dis tractors which 
give insight into common misconceptions. If revision is going to cor- 
rect errors, it is important to know what errors need correcting. Free 
response items are also useful in formative evaluation. This is par- 
ticularly true in mathematics where it is informative to observe the 
approach one takes or notice how the pattern of response changes fol- 
lowing instruction. Frequently given incorrect responses often indi- 
cates trouble spots. 

A few items that are easy before instruction may be desirable. 

Most items that are initially easy should be items which test concepts 
or skills that the developer hopes to maintain at a high level during 
the year. Items which are much easier or harder than expected before 
instruction are indeed useful. These item,., may suggest to the developer 
that he modify his planned approach to a topic because pupils know more 
about the topic than he thought. However, too many initially easy 
items weaken the usefulness of the item pool for evaluating the cur- 



riculum. 



Charac teristics of Test Instruments 



For item-sampling to function properly it is necessary that every 
pupil have the opportunity to respond to each test item. It is just 
as important that the last item on a test be attempted as the first if 
a true measure of the difficulty of the item is to be obtained. l^Jhile 
it is reasonable to place the more difficult items at the end of a 
speeded or rigorously timed test, item- samp ling instruments are likely 
to be more effective if easy and hard items are intermixed. If a pupil 
senses that all the hard items are at the end of the test, then upon 
reading two or three problems that he can not work he may become dis- 
couraged and give up. 

It is likely that questions other thsn multiple-choice will be 
used during a formative evaluation. Since pupils rarely become dis- 
couraged when responding to a multi.ple-choice item, these should be 
first on the tests. This study always started a test with an e .t>y item 
and then varied the difficulty of the items over the remainder of the 
test. 

The use of item-sampling in a growth study implies that improvement 
in skills and concepts is expected during the period of the study. Since 
the item pool is administered repeatedly over the year it is natural for 
the evaluator and the curriculum developer to be concerned about the 
effect of the initial testing period--the period where many of the con- 
cepts and skills required by the test items have not been covered. Some 
pupils expect to do extremely well on ever}^ test while others do the 
best they can and forget the test upon finishing it. The former group 
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in likely to feel more comfortable (less anxious) if the instructions 
for the tests make it clear that they will be har<3» Also> teachers 
should be informed about the purpose of the testing and that while 
initially the tests yill be hard, they will become progressively easier. 
A preliminary letter to teachers describing the testing procedure and 
a copy of the instructions for the first administration are included 

in Appendix B. 

Referencing the Items 

A test item is included in a formative evaluation because it evalu- 
ates a goal of instruction. The curriculum developer has at least a 
rough idea about the level of performance he expects on the item fol- 
lowing instruction. He also knows if the item represents a simple re- 
call of a fact, a complex extension of instruction, or something between 
these two extremes. Therefore, it is reasonable for the curriculum 
development staff (including the evaluator) to decide upon a classifica- 
tion system for items used in the study. There is a tendency to use 
too many categories for classifying items. Chapter V discusses the 
categories used to classify items for PIA-6. Five categories were used: 
three mastery levels and two transfer levels. A lower bound criterion 
was specified for each category. The lower bound reflected the aspira- 
tions of the PIA staff for the item following instruction. 

Items should be classified before instruction begins for several 

important reasons:. 

1) As the items are classified the project becomes more 
cognizant of its goals* 
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2) A few useless and poorly worded items are likely to be 
discovered* 

3) Thej classification can be done objectively. 

The curriculum developer may feel uneasy about classifying items 
and then having to report that certain items failed to meet criterion. 
However, formative evaluation does not represent evaluation of the 
revised product, but rather an evaluation of the developmental year 
effort. The advantages of classifying each item far outweigh any fear 
of failing to meet criterion. 

Use of Results During the Formative Year 

If the evaluator keeps test results a '-secret" they are of no 
value. For PIA-6 the test items were grouped into homogeneous cate- 
gories. These categories were updated at each testing period and 
copies were given to each staff member. The , "r", and "c" coding 
system used between testing periods (see Chapter VI) was useful. It 
is recommended that only two s 3 mibols be used> one for extensive coverage 
and one for significant review. The "c" symbol was used between testing 
periods to indicate "related coverage." It was extremely difficult to 
decide if coverage related to a particular item had occurred between 
testing periods. The "*■' category was uscu to signal major coverage 
and could almost be placed by looking at the program titles. The 
symbol "r" was used to indicate that significant review related to the 
item had occurred. Whether review had occurred could be objectively 
determined. The use of a code between testing periods is desirable. 

It indicates at a glance how the item was affected by instruction over 
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the year. 

Another aid to the curriculum project would be a brief summary 
of the highlights of the testing period. This summary could include 
interesting results on items related to intervening programs, topics 
which need review, and results which have implications for future pro- 
gram planning. The present study would have been more effective if 
greater attention had been given to this summary. The evaluator must 
realize that one of his jobs is to help interpret results-- the cur- 
riculum developer often does not have time to become absorbed in test 
data. 

Summary 

Item-sampling proved to be useful in formative curriculum evalua- 
tion. It was shown tl.at item-sampling could be successfully used in 
a growth study where it is desirable to obtain a profile of change over 
a period of time. It is clear that item-sampling provides more de- 
tailed information to staff than traditional testing that uses a single 
test with items not necessarily designed for the curriculum. The fact 
that the evaluator can hand-pick all test items is a major advantage 
in item^s amp ling. Since the "items" are the focus of the evaluation, 
considerable care must be taken in their selection. Although the design 
of an item-sampling study is si1I^>le, the parameters involved in such 
a study (e.g., population size, sample size responding to each test, 
number of items per test, etc.) must be decided upon well in advance 
of the study. An example was given earlier in this chapter which il- 
lustrates how these parameters operate together. It was suggested that 



once an estimate of the population size is known, and the accuracy of 
the sampling estimates is specified by staff, the number of tests that 
may be used is determined. To administer several different tests to 
a given class, uniform, instructions and tests of similar length are 
required. Hence, once the number of tests that can be used is known, 
the number of items about which one can gather information is a simple 
function of time available for testing. 

Criterion referencing of items was used in this study and is recom- 
mended, provided that items are classified early in the study--prefec- 
ably before any testing is done. By referencing the items before tne 
initial testing period it is likely that undesirable items will be un- 
covered. This would strengthen the item pool. Together, item-sampling 
and the criterion referencing (classifying) of items provide staff 
with an efficient, objective and useful evaluation techinque. 
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APPENDIX A 



Table lA represents proposed topic coverage for Patterns In Arith- 
metic-6. Although it was developed during the summer preceeding the 
actual production of the program, this outline represents a fairly ac- 
curate outline for the final product. This table together with Table 
2A was used as a guide in developing and collating the test items. 



TABLE lA 

PROPOSED TOPIC COVERAGE FOR PIA-6 



I. Geometry (30%) 
A. Measurement 

1. Linear: 

2. Area: 



3. Angle: 



Review standard units of linear measure j intro- 
duce metric systemj review perimeterj conversion 
of units by ratio 

Review standard units of area measure j inner sind 
outer areaj formula for area of rectanglej use of 
ratios to convert units; ability to compute area 
or .'^gle, parallelogram 
Introduce terms such as ray,'" acute, obtuse, 
straight and vertical angles; use of protractor 
to measure a given angle or angle of rotation; 
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point out congruence is equivalent to equal 
measure. 

4. Volume: The concept of volume and if possible extend 

the idea of inner and outer area measure to 
inner and outer volume; standard units; volume 
of box (rectangular solid); perspective drawings 
B. Non-metric aspects of geometry 

1. Sections: Notion of a plane section of a solid; use of terms 

plane, region, polygon, parallel; 2-D drawings 
of 3-D figures; use sections of solid figures to 
get rectangle, square, circle, ellipse 

2. Reflections: Review construction of a reflection pointing 

out orientation shift; congruence after reflection 

3. Dilations: Construction and properties; similarity (review); 

(Similarity) 

show two similar figures can be related by com- 
binations of rigid motions and/or dilations; no- 
tion that corresponding sides of similar figures 
are propbrtional; scale drawings as application 
of similarity; make simple scale drawings 

4. Symmetries: Lines of symmetry of figures and relation to 

dilations and reflections 

II. Fractions (30%) 

A. Interpretation: The meaning of a fraction (shaded figures, 

number line) 

B. Equal Fractions; Fractions associated with counting numbers, 
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C. Operations: 
(+, x) 







i.e., equivalent fractions; cross product 
test 



Review addition and subtraction of fractions, 

2 

least common denominator; meaning of - of 6 

as an introduction to multiplication of fractions; 

number line argument for 6 xi...then 6 x ^ = 

"2 






|x6-but6x|=*~x-|=? 

We know the answer must be 3 from the number line 
12 

argument**-bat is another name for 3. Hence, 

X -r = /^o ^ o\ » £quivalence of of 6 and — 
22(2x2)^ 3 3 

X 6; use of regions to motivate multiplication of 
rationals; use of a rectangular model to illus- 
trate commutativity, i.e.. 




Eventually get to general rule for multiplication 

12 “IQ 

of fractions; give attention to ~ x — and — x — i 

2 3 6 12 

are equivalent (uniqueness aspect); mixed numbers 
via distributive property, e.g., 4 x = 4 x 

(3 +‘^ ) = (4x3)+ (4 X— ) other combinations 

2 13 2 

such as T X 3'r, 2 t x 6—, etc . 

3 2’ 4 3 
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D. Decimals: Review notation for decimals; interpretation of 

decimals; writing a rational number as a decimal 
when (a) denominator is 10, 100, 1000, etc. (b) 
denominator is not so nice; addition and subtrac- 
tion of decimals; multiplication of decimals; 
division of decimals, e.g., 10.6 -f 0.3, 0.6 -r 3, 
etc. 

E. Operations: Division of rational numbers including (a) a re- 

view of equivalence of the statements n = 12 4* 4 

and 4 X n = 12. Use this to conclude 12 *f 4 and 

12 1 

are the same since 4 x n = 12 implies — x 4 x 

1 12 

n = -^ X 12 = — (b) the solution of problems like 

.11 2 
n = 5 ^ _ X n = 5 (c) problems like n = — -f 

(d) division of mixed numbers (e) simplifying 

fractions to a basic fraction, cancellation to 

simplify computation (f) tabulate functions using 

rational numbers without using the word function 

III, Counting Numbers (15%) 

A. Operations - Properties of 0 and 1 

1. Review multiplication, expecially problems involving 3 
digits such as 263 x 491 

2. Division algorithm, writing the sentence to correspond 
to division with (without) a remainder 

B. r actors 

1. Prime numbers, composite numbers 

2. Greatest common divisor, least common multiple 




100 






3. Exponents (16 - 2 ), represent a composite number as a 
product of primes using exponents 



C. Equivalence 

1. Equivalent sentences involving integers (fractions); 

2 X n = 16 x2xn=-^xl6 

2 2 

Story problem applications 

2. Equivalent conditions involving integers (fractions)- e.g., 
4 X n < 8 4 -— n < 2 

D. Functions - tabulate 

1. Graph a relation oh the number line 

2. Introduce coordinates and plot ordered pairs 
IV. Ratio (5%) 

A, Cross product 

2 ‘ a 

1. Solution of problems like — = ~ using cross product 

2. Converting from one standard unit to another (e.g., cm. 

. to inches) 

B. Percent 



1 . 65 %^ 



f 



100 

-► decimal 






.75 



75%). 



V. Miscellaneous (20%) 

A. Probability 

1. Sample space 

2. Events as subset of the sample space of events 

3. Assign probability to an event by ratio of number of ways 
favorable to the total number of outcomes for equally 
likely events 
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Complement, of an event - given the probability of an event: 
vhat is the probability of its complemert 

B. Statistics 

1. Nature of statistics 

2. Use of graphs to represent statistics visually 

3. Measures of central tendency - the average, mode (?) 

C. Problem Solving - extensions of program content 

1. Involving fractions 

2. Equivalent sentences 

3. Reading graphs, probability 

4. Synthesis of various aspects above 

TABLE 2A 

ITEM ALLOCATION BY TOPIC 

The percentages i'udicate.d below were used as a guide in collating the 
tests. When considered together the twelve tests represent closely 
content and percent coverage specified in this table. 

I. Measurement (87o) 

A. Linear (2%) 

B. Area (3%) 

C. Volume (2X) 

D. Angle (1%) 

II. Ratio-Cross Product (3-.5%) 

III. Scale Drawings (2%) 

IV, Fractions (25%) 

A. Meaning of fractions (3%) 

B. Equal fractions (3%) 

C. Ordering fractions (3%) 

D. Addition and Subtraction (7%) 
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E. Multiplication and Division (8%) 

F. Cancelling common factors (1%) 

V. Decimals (13%) 

A. Interpretation of decimals (3%) 

B. Converting to decinial (2%) 

C. Addition and Subtraction (3%) 

D. Multiplication and Division (5%) 

VI. Percent (7%) 

VII. Division (Long) (6%) 

A. Understanding the algorithm (2%) 

B. Operating with the algorithm (4%) 

VIII. Integers (4%) 

A. Multiplication (2%) 

B, Negatives (2%) 

IX. Reading Charts and Graphs (2%) 

X. Number Line (2%) 

A. Related to fractions (1%) 

B. Related to decimals (1%) 

XI. Equivalent Sentences (2%) 

XII. ProbMility (3%) 

A. Counting processes (1%) 

B. The certain and impossible event 

C. Assigning probabilities, recognizing the most (least) 
probable event (1-2%) 

Xril. Functions (3%) 

XIV. Statistics (3%) 

XV. Geometry - Non Metric (10%) 

A. Visualize 3-D objects (2%) 

B. Reflections (4%) 

C. Rotations* (2%) 

D. Sjnnmetr}’ (1%) 

E. Dilations* (1%) 







XVI. Applica^ons - Extensions: involving notation, more complicated 

story problems, science problems (7%) 

*This topic was not tested. 
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This appendix contains copies of the various materials that were in- 
volved in the testing. Tn order, the following materials are included: 
Bi) A preliminary letter explaining the testing procedure 
B2) A copy of the instructions used for 
B3) A copy of the instructions used for 

B4) The form which was completed by the teacher and returned at 
each testing period 
B5) A sample class list 

B6) A copy of each test as it appeared following the first test- 
ing period 

B7) A description of changes made in a few items following T^. 






TESTING PROCEDURE FOR PIA-6 



Two types of testing will be done during the aevelopmental year of 
PIA-6. One type will be the traditional type of classroom evaluation 
of pupils. This will involve a mid-year and end-of-year test of pupil 
achievement. This testing will provide information about class per- 
formance and- pupil achievement. 

The second type of testing will represent a somewhat new approach 
to evaluation. While a program is being developed it is important for 
project personnel to have periodic feedback to see if program objec- 
tives are being met. It would be nice to have feedback after each 
program, but this is not practical. To compromise we have decided to 
ilse a large pool of items administered 4 times during the year to 
supplement and complement the periodic meetings with teachers partic- 
ipating in PIA-6. The item pool will reflect program content and most 
items will be designed to measure specific objectives of instruction. 
However, a few items will be designed to measure extensions of ideas 
developed in the programs. 

Ten or twelve, 20-item tests are planned for this second type of 
testing. Each test will contain a different set of items and all te;5ts 
will be administered at each testing period. Each test will be divided 
into two sections - multiple choice and computation (problem solving). 
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The tests will be sent directly to you; we request that you administer 
the tests and return the materials to us for grading. Since your claSs 
will be working on 10 or 12 different tests, the problem of timing will 
be important. Testing done in PIA~5 demonstrated that 30~^!0 minutes 
was sufficient time for a class taking 9 different 20-item tests. It 
is likely th<- t a similar time limit will serve for PlA-6, Considerable 
effort will be made to make the tests approximately the same length. 

It may seem odd that all items will be given at each of the four 
testing periods. However, in £ o r ma t i on gathered on each item at each 
period can be useful for developmental purposes. For example, the 
initial testing period will provide a base for each item so that growth 
during the year can be determined. It is expected that maximum growth 
on an item will occur on the testing period immediately following PIA- 
6 coverage of the concept involved in the item. Since some topics are 
covered more than once during the year, it is expected that some items 
will show gain more than once. In addition to providing a base for 
each item, the initial testing period will provide the staff with 
valuable information to aid in the planning of programs. 

The active cooperation of every teacher participating in PIA-6 is 
important if this second type of evaluation is to be effective. You 
should understand what this type of evaluation will not do as well as 
what it will do. It will not provide information about individuals 
or classes, but about the entire group of pupils participating in PIA- 
6, These test results will reflect group performance on the entire 
pool of items. The first type of testing will provide information use- 
ful for individual and classroom purposes. 
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Since for the second type of evaluation the same tests will be 
used at each of the testing periods, two aspects are worth mentioning. 

(1) These tests will probably be very difficult at the beginning 
of the year, but should become progressively easier. Pupils s'i.^ iu 
be aware of this and encouraged to do their best even though there 
will be items beyond their comprehension. 

(2) Some pupils may take the same test more than once. This is 
undesirable and can be minimized by the way we send the tests to 
you and the manner in which you distribute the test materials. 

More detailed information about this point will be included in the 
directions for administering the tests. 

There will be two groups of pupils participating in PIA-6. Those 
who participated in PIA-5 and those who did not. We woulu like to 
make a distinction between these two groups of pupils. Therefore, 
we will ask you to send a class list to us about mid-September indi- 
cating whether each pupil did or did net participate in PIA-5. The 
class list will serve another function. It will be used as a check to 
see how many pupils take the same test more than once. You will not 
have to keep track of this nor will you be expected to correct any 
tests of the second type. 



◄ B2 ► 

PATTERNS IN ARITHMETIC 
TESTING PROGRAM 



In an earlier letter we mentioned that two types of testing will 

r t ' 

be done during the developmental year of Patterns In Arithmetic (PIA-6). 
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one type will be the traditional type of classroom evaluation of pupils 
and will consist of a mid-year and end-of-year test of pupil achieve- 
ment. This testing will provide information about class performance 
and pupil achievement. 

The second type of testing will represent a new approach to eval- 
uation. While the program is being developed it is important for pro- 
ject .personnel to have periodic feedback to see if program objectives 
are being met. To accomplish this we have decided to use a large pool 
of items places in 12 distinct tests. These tests will be administered 
4 times during the year to supplement the periodic meetings with teach- 
ers and administrators. Copies of these tests are included with this 
letter. Administer the tests . before the: September 27 meeting. At 
that meeting aspects of the testing activities will be discussed. 

Before giving the tests please read the following General Comments 
and, Directions, for the Testing. 

CEHERAL-. CC»1MENTS. 

L„,, There are twelve different 20.ritem "Question Sheets" (tests) with 
many questions relating -to topics, that will not be covered until 
later this Tlie V Quest ion Sheets" ar^ numbered fron 1-12 in 

■ the upper - lertrhand: corner of page 1.. 

2, The a^e set of twelve,. 20.ritera tests will be used for the 4 test- 

:P?tipd^: September, December, February arid May. Since we do 

not want a pupil to take the same test twice, a procedure will be 
explained below for accomplishing this. 

3. The tests will be difficult at the beginning of grade 6, but should 



no 



become progressively easier during the year. 

4. This phase of the testing will not provide you with any useful 
information about individual pupils or about your class as a whole, 
information gathered will be analyzed on a group basis and not a 
per class or per individual basis. For example, we expect about 
90-100 classes to participate in the developmental program and 
testing activities. Tliis means that any given test (out of the 

12 different ones) will be taken by only 2 or 3 pupils in your 
class. We will take the 2 or 3 pupils that respond to test 1 in 
your class and put their papers together with all other pupils 
responding to test 1 and analyze these as a group. The same pro- 
cedure will be followed for each of the 12 tests. 

5. You will not be expected to grade any of these tests. The answer 
sheets should be returned to us immediately after the testing and 
the test questions destroyed. A new set of tests will be sent 
each time the tests are to be given. 

6. IMPORTANT : Directions for Passing Out the Question Sheets . 

As mentioned above, the same set of tests will be used 4 times. 
Since it is undesirable for a pupil to take the same test twice, 
the tests must be passed out in a planned order. If you will look 
through the "Question Sheets" you will see that they are arranged 
in a repeating pattern of 12. For example, the pattern could be 

2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 1, 2, 3, 4, Do Not Disturb 

this pattern. 

The pattern arrangement will insure that each test gets taken 
about the same number of times. Pass the "Question Sheets" out. 




m 



in sequence, until every pupil has one. The pupil will put his 
name in the upper right-hand corner of the answer sheet which is 
attached to the "Question Sheets," We will make a class list for 
your class from the names on the answer sheets. The class list 
will contain the number of the "Question Sheets" taken by each 
pupil. This will be returned to you at the second testing period 
so that you may make certain that no pupil gets the same test 
again. Hence, it is essential that you enclose your name and 
school address with the answer sheets , A form for this information 
is enclosed*, 

SPECIFIC DIRECTIONS FOR Tri£ TESTING^ SEPTEMBER PERIOD 
READ OVER CAREFULLY BEFORE THE TESTING 

1, Reserve about 45 minutes for the testing, 

2, Make sure each pupil has two pencils and an eraser. The back of 
the test cover and the question sheets can be used for scratch 
paper. 

Follow the steps below and read the material in quotes to your 

class. Before passing out the tests say slowly - 

"i have some quesions about ari>:hmetic that I warn: you to 
answer,. Spme of tl^e questions will be difficult and you 
may not know the answers. Now I am going to pass the 
questions out, but dp not open them until I say to," 

Now pass pjut the "Question Sheets" one-by-pne in the order you 

receive, them , After everyone has a question sheet have each pupil 



tear off c.arefuVly the answer sheet tha,t is stapled with the 
questions and is the last page. Then say - 




V, 
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"Has everyone removed the answer sheet? (pause) Now 
write your name clearly in the upper right-hand corner." 
(Allow time for this) 



Now say 



"Did you use TV arithmetic in grade 5? If your answer 
is yes write yes under your name. If your answer is 
no write no under your name." (Repeat if necessary) 



Then say - 

"There are twenty questions in all. Some questions are 
multiple choice. You should guess at the answer only 
if you can rule out some of the choices. All answers 
go on the answer sheet. Now open your questions to the 
first page and lets read the instructions, (pause brief- 
ly) . . . You may write anynwhere on the question sheets. 
Questions 1-13 are multiple choice. You should decide 
which choice is correct and circle your choice on the 
answer sheet provided. You should have enough time to 
work on every question. Do not spend' too much time on 
any problem." 

Now ask informally if there are any questions. If there are no 
questions say - 



"You will have about 30 minutes to answer all the ques- 
tions . . . now begin." 



Feel free to answer any questions during the testing that are not 
related to the solution of a problem. After about 18-20 minutes wander 
about the class. If some pupils appear to be moving too slowly, sug- 
gest that they start on problems 14-20. 

When you feel the majority of pupils are finished, collect the 
"Answer Sheets" and "Question Sheets," If about everyone has not 
finished after 35 minutes, collect the materials au3^7ay. 




(SEE NEXT PAGE FOR RETURNING MATERIALS) 



RETURNING MATERIALS (September, 196 8) 



Return only each pupils answer sheet and this sheet .* Destroy 
all "Question Sheets" soon after the testing is complete. 

Please complete the information below and return it with the 
answer sheets in the enclosed envelope. 

Teacher Name 

School 

School Address 



How many pupils are in your class? . 

About how long did the average pupil spend on the test? 
Number of pupils absent? 



*In an earlier letter a class list was requested. This will not be 
necessary since we will construct the list from the answer sheets. 

◄ B3 > 

PATTERNS IN ARITHMETIC - 6 
TESTING PROGRAM 

Enclosed find test materials and directions necessary for completing 
part 4 of our 4 part testing program. This is perhaps the most impor- 
tant of the four testing periods. May I suggest that upon completion 
of the testing program you retain cne copy of each of the twelve tests. 
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A report will be sent to each teacher and administrator involved in 
the study. The tests will be useful for interpreting the results and 
can serve as a source of questions for class evaluation next year. 

WHEN TO ADMINISTER THE TESTS ; On May 15, Program 63 on exponents will 
be shown. Administer the tests a day or two after you have completed 
_tl^ exercises associated with Program 63 . Depen^;i,ng upon your class , 

May 16, 19, 20, or 21 should provide an adequate choice of days. 

* 

Before giving the test please read over the following general 
comments and Specific Directions for Testing . 

GENERAL CQMMS NTS 

1. The same twelve, 20- item tests are again used. The number of each 
test is in the square in the upper, right-hand corner of the cover . 

2. IMPORTANT ; 

A class list for your class is enclosed. It was prepared from 
answer sheets returned at T^ and modified following T and T. . The 
test number that each pupil should receive is indicated beside his 
name unde r the column headed T^ (to correspond to the fourth testing 
period). This column represents a random assignment of pupils to tests 
and it is very important that this assignment remain undisturbed. A 
few extra tests are included for pupils whose names are not on your 
"class list. It makes no difference which test these pupils take. The 
important thing is t o make sure that each pupil named on the class list 
gets the test number specified under T^ . 

Considerable effort has been made to send the tests to you in the 
same pattern that they appear under T^ on the class list. It is 
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-► advisable that you put the name of each pupil on the front cover of 

the test he is t o receive . For example, if it is indicated under T, 

“ " 4 

that the first person on your class list is to receive test number 7. 
then you should place his name on the front cover of test 7 booklet. 
Your booklets are hopefully arranged so that the first booklet should 
correspond to the first person on your class list, etc. 

3. Columns T^, and on your class list have been marked out to* 
lessen the chance for error. 

4. 3e sure and have each pupil circle yes or no on his answer sheet 

to indicate whether he participated in PIA-5. This information is 

% 

still needed to group tests. 

5. You will be expected to grade any of these tests. The answer 

sheets, attached to the back of each test should be returned to us 
immediately after the testing. Copies of each test may be saved for 
your own use next year and for interpreting data which you will receive 
in the form of a "report on the project." 

SPECIFIC DIRECTIONS FOR THE TESTING - MAY PERIOD 
READ OVER CAREFULLY BEFORE THE TESTING 

1. Reserve about 45 minutes for the testing. 

2. Make sure each pupil has two pencils and an eraser. The back of 
the test cover and the question sheets can be used for scratch 
paper. 




Follow the steps below and read the material in quotes to your 



class . Before passing out the tests say slowly - 



"Today I have some more questions about arithmetic that I 
want you to answer. Now I am going to pass the questions 
out, but do not open them until I say to." 



Now pass out the tests one-by-one making sure each pupil gets the 
test number indicated in column on your class list . The number 
of each test is on the front cover in the square in the upper, 
right-hand corner. 



After everyone has a test, have each pupil tear off carefully the 
answer sheet that is stapled with the questions and is the last 
page of each test. Then say - 

"Has everyone removed the answer sheet? (pause) Now 
write your name clearly in the upper right-hand corner." 

(Allow time for this) 

Now say - 

"Did you use TV arithmetic in grade 5? If your answer 
is yes circle "yes" under your name. If your answer 
is circle "no" under your name." (Repeat if necessary) 

Then say - 

"There are twenty questions in all. Some questions are 
multiple choice. You should guess at the answer only 
if you can r.uls out some of the choices. All answers 
go oh the answer sheet. Now open your questions to the 
first page and lets read the instructions, (pause briefly) 

. . . You may write anywhere on the question sheets. 
Questions i-13 are multiple choice. You should decide 
which choice is correct and circle your choice on the 
answer sheet provided. You should have enough time to 
work on every question. Do not spend too much time on 
any problem." 



Now ask informally if there are any questions. If there are no 
questions say - 
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"You will have about 30 minutes to answer all the 
questions . . . now begin." 

Feel free to answer any questions during the testing that are not 
related to the solution of a problem. After about 18-20 minutes 
wander about the class. If some pupils appear to be moving too slowly, 
suggest that they start on problems 14-20. 

When you feel the majority of pupils are finished, collect the 
"Answer Sheets" and "Question Sheets." If about everyone has not 
finished after 35 minutes, collect the materials anyway. 

(SEE NEXT PAGE FOR RETURNING MATERIALS) 

B4 

RETURNING MATERIALS (MAY, 1969) 

Return only each pupils answer sheet and this sheet. 



Please complete the information below and return it with the answer 
sheets in the enclosed envelope. 

Teacher Name 

School 

School Address 

^Zip 

Date Tests were Administered 

About how long did the average pupil spend on the test? • 

ENCLOSE TUTS FORM WITH THE ANSWER SHEETS 



O 







◄ B5 ► 
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Class Size 





^1 


T 

2 


T 

3 




Time 


20 


25 


25 


30 

. % - 


Absent 


0 


2 


3 


2 



Name 

School 

Address 





Pupil Name 


PIA-5 


T 

1 


T 

2 


^3 




1. 


Janet M. 


+ 


9 


11 


5_ _ 


2 


2, 


Paul R. 


+ 


5 


6 


9 


_S 


3. 


Betty S. 


+ 


11 


9 


J - 


L 


4. 


Tama B. 


+ 


12 


2 


1 


- 5 


5. . 


Carl F. 


+ 


8 


9 


4 


5 


6. 


William C. 


+ 


7 




9 


B 


7. 


John B. 


• 


2 


3 


-8 




8. 


Richard M. . 


+ 


6 


12 


10 


11 


9. 


Fred K. 


+ 


9 


12 


1 


- 7 


10. 


Jerry J. 


+ 


4 


1 


11 


8 


11. 


Karen S. 


+ 


8 


1 


2 


i 

6 4 


12. 


Vera B. 


+ 


12 


4 


3^ 


Jl 


13. 


Herb K. 


+ 


3 


1 


6 




14. 


Dan W. 




3 


6 


_L_ 


9 


15. 


Tom R. 


+ 


5 


3 




12 . 


16. 


Evelyn H. 


+ 


10 


7 


12^ 


■3 


17. 


Larry S. 


+ 


9 


10 


7 


_4 


18. 


Kay S. 


+ 


11 


10 


8 


^ 


19. 


Bobby P. 


+ 


2 


5 


12^ 


4 


20. 


Rochelle M. 




7 


2 


11 


10 


21. 


Joyce B. 


+ 


1 


7 


6 


IJ. 


22. 


Fred W. 


+ 


10 


4 




1 


23. 


Irv K. 


+ 


8 


11 


10 


7 


24. 


June V. 


_ 


4 


8 


7 


9^ 


25. 


Henry V. 


+ 


6 


8 


2 


3 



o 

ERIC 



i 
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PART I 

TWELVE TESTS AND GROWTH GRAPHS 



PATTERNS IN ARITHMETIC 
Grade 6 
1 



TEST 1 

tJUKSTIO N .SHEETS 



•nscnicLioii.s; 



You iwiy wrile ;iiiywlieie on iIk: (|ik>.s1 i oh jiIiccIh. (/iiiHlIoiifi |-|’J /ire 
imillipio dioice. You .sliould decide wliidi clioice Jh correc! and circle 
y»)iir ciioice on I lie answer .slieci provided, 

You .sliould Have cuoukH lime lo work on every que.sl ion. Do noL spend 
1.00 iiHicIi lime on any probloin. 



I 



1‘. WIiaL is the distance around the rectangle 
he low? 



100^ 



a) 7 

b) 8 

c) 14 

d) 16 



iO -- 



*******-.VvVV, 



*i‘l Ti, 



2. Which of the following sentences is equi- 
valent to n X 6 = 48? 



n. : 


= 6 X 48 


looA 


6 


c 

II 

00 


- 


n 


00 

II 


50 


48 


6 = n 


- 






• • • • 



“T T 1 T“ 

Tl Ti, 



3. What is the greatest number that divides 
both 28 and 42? 

\ o 10 0^ 

a) 2 
h) 7 



c) 14 
cl) 42 



bO 









^ 1 1 T" 

Tj T, 






On the number line above, point A can be 
named by 



a) i 



b) 1 i 



c) 

d) 



8 

7 

3 

4 



1 — I — I — I — 

'I’l Ti, 



Vf #V vV ;V #V;VVf vWf ;V 



5. What percent of the above figure is shaded? 

a) 40 

b) -iO 

c) 2'i 



d) 8 



«"/"A*vVvV‘.V*.VvV »V’»V 



T I - r- ^ 



[ ERje 



. a • M HI LuimL.. II i; mmm^vmh iu'u> '.m ->^UliJUiUilU^vnPliiilPilP9PiPPI9iPPHIPIill^^ 



9 



i 




6. Liglit travC/S about 186,000 miles pel: 

second* About how long will it take light 
to travel 186 miles? 

a) 0*001 second 

b) O.Ol secomi ^ r 

c) 1000 seconds - * 

d) 3 hours ' 

yv'**Vr*****;V ^ 



Estimate the difference between the 



greatest and least 
earned . 

a) about $17 

b) about $19 

c) about $20 

d) about $21 

e) about $25 



amounts of money 







id: idt :V '.V 



7* We have many s^alldavd units for linear 
measure* Four of these are yard, inch, 
foot and meter. Relative lengtlis of 
these four standard units are repre- 
sented by the line segments below. Which 
line se^pnent represents one foot? 



c) 

d) 

iciciddddds 



10 . 



The rolati.onsliip 



•0 

10 



C) 

d) 



e) 



\ 

1 

2 

1 

12 

1 

24 

1 

36 

1 



indies 

yards 



Is expressed by 



1 0 



• • 



iO -- 



~I 1 1 T" 

Ti T\ 



Questions 8 and 9 refer to the Grapli below 



Karninj’.s of Six hoys 





idfiridddddrJe 




The arrow above can spin freely about the 
center of the circle. Which section of the 
circle is the arrow least likely to stop 
on? 



8. Which three boys earned about the same 
amount of money? 

a) Tom, Harry and John 

b) Dick, Joe and John I • • * * 

c) Tom, Joe and Jim ^ 

d) Tom, Harry and Joe V 



T T 



a) A 

I * — • 

b) B - . • 

c) C " 

d) D ■ 

e) F, ^ — I — I — i — r 



i:idrJe idddd: ic 



o 

ERIC 
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12. In the above triangular pri.siii, the 
bottom face is named by 

a) AbF 

b) CDE 

c) BCl-F 

d) ABCD 



100^ 



/O -- 



• f « 



1 1— 

'i*l 'J\ 



; v»' v; * v; V; * vc 



13. A triangle lias a perimeter of 60.3 inches. 
If each side is 2 inches longer what 
would be the perimeter? 



al 

h) 

c) 

d) 



62.3 
6A.3 

66 . 3 

68.3 






GO ’It) Nfl-XT PACI* 



100/ 



50 -- 



T 1 1 T“ 

i' \ 'I'l, 



o 

ERIC 
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Work Che remaining problems on scratch paper or beside tlie problem and place 
your answer on the answer sheet in the space provided. 



14. 571 X 68 - 



. 15. 




9 



loo'^-n 




Tl Ti. 



1 oo'/il, 

16. What is 157., of 80? 



I— 1— f-*r 
I ] '1\ 

17. Three pieces of paper weigh 
0.03 pounds. How much will 
12 pieces of paper weigh? 



18. E = M 

40 200 




• « ^ 






▼ 

T"^ — r 



T 




Work problem 19 on the back of 
your answer sheet. Leave your 
answer there. 

19. 3879 4- 27 = ? 



l 0 0^ 
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1‘A'ni-RNS IN ARl'niMKTIC 
Cracic 6 
1 



Name 



Did you use TV aritliinetic 
in grade 5? Yes No 



Circle your choice 



ANSWliR Slll-:iiT 



1. a 



8 . 



2. a 



9. a b 



3. a 



10. a h 



4. a b 



11. a 1) c d 



5 . a b c d 



12. a 



6. a 



13. a 



7. a b c d 



Place your answers for problems 14-20 in the blanks below. 



14.. 



18. 



15. 



19. Answer on back of 
this sheet. 



16. 



20 . 



17 . 
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I'ArrKUNS IN AUnilMI'IIC 

(it*m)e 6 



TEST 2 

QUESTION SHEETS 



Instructions: You may write anywhere on the question sheets. Questions 1-13 are multiple 

choice. You should decide which choice is correct and ci rcle your choice 
on the answer sheet provided. 



You should have enough time to work on every question. Do not spend too 
much time on any problem. 




1 . 



The 

a) 

.h) 

c) 

d) 

e) 



above figure is a 

c i VC 1 e 

pentagon 

rectangle 

square 

triangle 



IOC 



50 




Ti 



3. The ratio of 



liters 



xs 



3.79 



gallons 1 
ratio, 1 liter must be about 



a) 

b) 

c) 

d) 



1 cup 
1 pint 
1 quart 

- gallon 






From this 



-| — r 



4. 



Another way to wri te 

a) 0.2 I 

b) 2.5 

c) 0.25 

d) 2.05 

:k it *** 




2. Mr. Jackson drove Monday, Tuesday and 
Wednesday and traveled 1260 miles. How 
many miles did he average per day? 

a) 420 

b) 500 

c) 630 

d) 1260 

irkik'k'k'^c'k'Srkik 

I ■ . .V 

Ti T^ 




5. 



If F = ( I X C) 



+ 32, 



what is F when 



C 

a) 

b) 

c) 



0 ? 

9 

1 + 32 
32 

^ + 32 



d) 0 







o 

ERIC 
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6 . 



Whic!) figure Iielow lias the same percent 
shaded as the figure above. 



•0 





c) 
















• • 



-T — I — 



* '!tic 



7. The sentence 0.083 = 83 x ^ Is true 

when S = ? 

n) 0.001 ] 

b) 10 

c) 100 

d) 1000 



• • • 



T^V-r 



8- If 1 in(?Ii represents 150 miles. How many 
miles is it from A to C if you go through 
B? 




9. 




icic'^rk'kic^e'*cirk 



If 2 X N = -j, what is N? 



a) 

b) 

c) 

d) 6 



1 DC 



7., 



0 -*• • • 



“I — r 
Ti 



frfnV-.'Wr**-;.-;.-* 



o 

ERIC 
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I 



o 
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Work the remaining problems on scratch paper or beside the problem and place 
your answer on the answer sheet in the space provided. 



I 00^ 





Work problem 17 on the back of your answer 
sheet. Leave your answer there. 



I 

17, 8708 V 9 = ? 





18. One inch on a map represents 6 miles. 
How many miles does 3 — Inches on 
the map represent? 



1 ooZ 




19. John has a stack of 500 pieces of 

notebook paper. How much does each 
piece weigh if all 500 pieces weigh 
3 pounds? 



20, Jim saw a sign in the store window 
which said ”207 OIT ON AU. SKATKS.” 
Jim bought a pair of skates for $8. 
How much were the skates originally? 



1 




• • 
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I'Arn-HNS IN AUlTllNKriC 
Cradc (> 
o 



Kaine 

Dill you use* 'I'V ;iri thiiiotic 
in grade 5? Yes No 



answi:r siii-riT 



Circle your choice 



1, a b c d e 



2. a b c d 



3 . a b c d 



4. a b c d 



a b c d 



b . a b c d 



7 . a 1) c il 



8. a b c d e 



9. a b c d 



10. a b c d e 



11. a b c d e 



12. a b c d 



13. a b c d 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16. 



20 . 




17 



Answer on back of 
this sheet. 
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PATfERNS IN ARITHMETIC 
Grade C- 
3 



TEST 3 

QUESTION SHEETS 



Instructions: You may write anywhere on the question sheets. Questions 1-13 are multiple 

choice. You should decide which choice is correct and circle your choice 
on the answer sheet provided. 



1. 



2 . 







You should have enough time 






much time on any problem. 


If 


N - 6 


= 8, then N is 




a) 


68 


10 0^- 




b) 


48 




• ’ 


c) 


14 


!.0 - 




d) 


2 










irk^k'kirk'k'k'kic 





Do not spend too 



T, 



T — r 



What unit oC measure would be most 
appropriate to express the length of 
the earth worm below? 






i 


10 0^ 


a) 


square inches 


- 


b) 


centimeters 


50 -- 


c) 


yards 


■ 


d) 


feet 






********** 

3. What number in place of Q will make the 
following true? 

_A □ 

10 “ 25 



a) 


5 


b) 


10 


c) 


19 


d) 


31 


e) 


62 i 



T — r 



1.5 






1.6 



I 1 1 I I I I 1 I 






In the riK^ire above « the part of the 
ininiher line from 1.5 to 1.6 has been 
divided into ten equal spaces* What 
number names point A? 



a) 

b) 

c) 

d) 



4.5 

3.0 

1.8 

1.53 



********** 



. -V 



1 I "! I I I I I I I I I I 

0123456789 10 11 12| 
Ruler 

3. Charles uses the ruler above to measure 
the length of a knife. How long is the 
knife? 



a) 

b) 

c) 

d) 



7 inches 

8 inches 



^ foot 



9 inches 

'k'hk’kicic'kic'kic 
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'kirk'k'kic'k'k'kic 
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6 inches 



6. Tlie large square above has been divided 
into four small squares. What is the 
perimeter oC a small square? 



••0 


3 


inches 


b) 


6 


indies 


c) 


12 


i nches 


cl) 


24 


i iichos 




7. 



Candy bars are 3 for 20c. How many could 
you buy for $1.00? 



a) 6 

b) 15 

c) 40 

d) 60 





8. If the area of the rectangle above is 
18, what is the area of the shaded 
part? 

a) 18 4. j : 




c) 3 3_, — , — ,—r 

d) 6 



9. 



10 



11 . 



12 . 



Which sentence below is not equivalent to 
0.9 X C = 27? 

a) 9 X C = 270 

b) c = 3.0 : 

c) C = 30 

• • 

d) C = 27 4- 0.9 - , • 

— I — I — I — I — 

T 1 'I'l, 



300 


+ 8 + 7 = 

5 




a) 


384.0 J 




b) 


302.5 : 


• « 

— • 


c) 


300.4 - 


• 


cl) 


308.2 


. -r- r- 



******* **vV 



Whicli of the following lO-gallon cans 
most nearly contains 10 quarts of water? 




Which of the following expresses 24 as a 
product of prime numbers? 



a) 3 X 8 ... 

b) 2x3x4 - 

c) 4 X 6 • 

d) 2 X 2 X 2 X 3 

****^V ******** 

1 — I ! — r 



13. 



Out of 100 cars tested, 4 were found to 
have bad tiros. What percent had bad tires? 



a) 4 

b) 0.4 

c) 0.04 

d) 40 







» 



O 
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Work the reinaiiiiii}- prol»Ic‘nis on acralch paper or beside the problw;, and place your 
answer on Che answer sheet in the space provided. 



14. 80 X 407 = ? 



15. 483 21 = ? 




16. 



What is 



1 

3 



of 



I 

5 



7 



17. 





18* If I inch n 2.54 centimeters, how 
many centimeters are in a foot? 



19. What percent of the large square is 
shaded? 





1 — r 






PATlTiRNS IN ARITHMETIC 
Grade 6 
3 



Name 

Did you use TV arithmetic 
in grade 5? ves No 



ANSW-R SHEET 



Circle your choice 



1. a b c d 

2 . a h c d 

3. a b c d 

^ . a b c d 

5 . a h c d 

6. a b c d 

7 . a b c d 



8 . 

9. 

e 10. 

11 . 

12 . 

13. 



abed 

abed 

abed 

a b c d e 

abed 

abed 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16 



20 
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PATTERNS IN ARITHMETIC 
Grade 6 
4 

TEST 4 

QIFESTION SHEETS 



rnstiuctJons; You may write anywhere on tlie question sheets. Questions 1-13 are multiple 
choice. You should decide wiiich choice Is correct and circle your choice 
on the answer sheet provided. 



You should "liave enough time to work on every question. Do not spend too 
mucli time on any problem. 

Read the paragraph below very carefully . Take your time to understand the 
examples. If you do not understand these problems go to problem 9 and come 
back to these later. 



The 8 problems which follow involve folding paper and cutting pieces out of 
the paper. For each problem there are sotne figures drawn to the left of 
the arrow to show how a piece of paper is folded and cut, in the example 
below, figure 1 shows the paper before it is folded. Figure 2 shows the 
paper after it has been folded. Figure 3 shows a shaded square which has 
been cut out through the entire thickness of the folded paper. The 4 
figures to the right of the arrow represent the possible appearance of the 
piece of paper after the shaded part is cut out and the piece of paper 
unfolded. Only one of these is correct. In this case the correct choice 
is c. 



Example 1 




paper is cut and 
unfolded 



Now look closely at example 2 and observe that b is the correct choice. 



Example 2 
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I'or each problem below look hov7 the paper is foltlecl and c-.uL, Then clioosc the figure 
that shows how the paper looks after it is unfolded. 

Circle your choice on the answer sheet. 



1 . 



2 . 



3 . 



h. 



5 . 



6 . 



7 . 



fold cut 

I 

I 



fold 



cut 




fold 



cut 




L— > 




L__ 



fold 



cut 










fold fold 

r-- 



l 



I 

I 
1 

I 

cut 

1 f 
I 
I 
I 
I 



Which shows the paper unfolded? 






O 

O 



o 



o 



o 



o 

o 









J) 






r 







fold 



L I I I V 

fold cut 



A 

V 



AA 

AA 



A 



V 



AA 

VV 




r* 

i 

I 

1 



I 



I 




I 1 i I I I 4/ 

fold fold cut 

■“! A 

I 



\ 



K 



\ 



A 





I ! 





— 1 
1 




1 

1 

1 


1 

L__. 


1 

1 



OO 



o 

o 



o 



o 



OO 

OO 




9. 



Which of the following corresponds to a 
counting number? 



a) f 




10 0% 


1 




50 ■ 


c) 1 






d) 1 


1 

2 








13. 



Another way to write 0.25 is: 



a) 

b) 



c) 

d) 



1 

25 

10 

25 

100 

25 

1000 







Ti T:, 



10* A square is nine inches on a side. What 
is its perimeter? 



a) 


9 


X 


9 






b) 


9 


+ 


9 




• • 

• • 


c) 


4 


X 


9 






d) 


2 


X 


9 










GO TO NEXT PAGE 



11 . 



John measured the top of his desk and 
found its area. Which number could be the 
area of John's desk? 



a) 2 ft. 

b) 90 sq. yds. 

c) 750 sq. in. 

d) 1 meter 






icicicicic^icirfrile 



136 



Work the remaining problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided. 



14. 



3 _l 
5 ' 4 




15. 0.2 X 0.3 = ? 



2 

16. What is ~ of 27? 




17. Tfiere are 2.54 cent iinetei.s in I incli. 
How many centimeters are there in 
10 inches? 





18. 16 is what percent of 20? 




19. A box contains 121 red marbles 87 

green marbles 148 yellow marbles and 
18 black marbles. If you close your 
eyes and pick a warble which color 
are you most likely to pick? 




• • 



T T 



20, Write "four and twenty-seven 
hundredths" as a decimal. 



O 

ERIC 
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PATTERNS IN ARITHMETIC 
Grade 6 
4 



Name 

Did you use TV arithmetic 
in grade 5? Yes No 



ANSWER SHEET 



Circle your choice 



1. a b c d 

2. a b c d 

3 . a b c d 

4 . a b c d 

5 . a b c d 

6 . a b c d 

7 . a b c d 



8. a b c d 

9. a b c d 

10. abed 

11. a b c d 

12. abed 

13. abed 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16. 



20 . 



17. 
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PATTERNS IN ARITHMETIC 
Grade 6 
5 



TEST 5 

QUESTION SHEETS 



Instructions; 



Vou may write anywhere on the question sheets. Questions 1-13 are 
multiple choice. You should decide which choice is correct and circle 
your choice on the answer sheet provided. 

You should have enough time to work on every question. Do not spend 
too much time on any problem. 



1. The sentence 3 x N = 12 is true when 
N = V 



a) 2 

b) 4 

c) 9 

d) 36 



iuo2, * • • 



50 + 






“I — r-*T — r- 
T| -1\ 



A BCD 

T* I ■ I ' J 'I ' I 'I ' j 'I • I ' I • I ' I ' j ' I ' j 'T 

12 3 4 






2. Which arrow above is pointing to a number 

between 2 4 and 2 — ? 

8 8 

a) arrow A 

b) arrow B 

c) arrow C 

d) arrow D 

irk'kic'kr k r k ' k k ic 



-t 



— I — r 



3. Which object below is about 1 meter long? 

a) Book 

b) Yardstick 

c) Car 

d) Bus 

krkirkic'k^kirk'k " 

-S— r 



-• — •- 



4. 



-2 + (-7) 

a) 9 

b) 5 

c) -9 

d) -5 

e) 14 



100^ 



>0 *■ 



w * 

— I — — r 



Ti T^ 



5. If we replace m by 4, then 
.m b.? 



m 



a) i2 

b) -4 

c) 5 

d) 20 



« 



"T r-"! r 



- ■--l -l, ■ .i , ■ ■■ a. ■ ■ 

U K Jl tCJC ft 



If (E,F) represents the number of edges 
(E) and the number of faces (F) , what 
is (E,F) for a cube? 



«) 


(4, 4) 


b) 


(6, 12) 


C) 


(12, 4) 


d) 


(12, 6) 



• • 



“I — I — I — r 
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31 

9 ( 284 
27 
14 
_9 
5 




7. In the division example above, the 
remainder is 

a) 31 

b) 9 

c) 284 

d) 5 



*****yr*>V>V* 



8. Kay made 200 cookies and used 8 cups of 
sugar. The next day slie used the same 
recipe, but made only 50 cookies How 
many cups of sugar did she use? 



a) 2 

b) 4 

c) 6 

d) 8 







9. Another way to write "four fifths of 
twenty" is 

a) (4 X 5) X 20 

3 - 20 : ^ 

‘a 

c) — X 20 - • 

d) 0,45 X 20 — I— +— r— r- 



10. Tf two distances are equal, wliat is tlie 
ratio of the first distance to the 
second distance? 

a) 0 

b) 1 to 1 

c) 1 to 2 

d) 2 to 1 

e) 4 to 1 

^'kic'k'kic'k’icici: 





area of the shaded region in figure A 
is 5 square units. The area of the shaded 
region in figure IJ is 2 square units. 

The area of the shaded region in figure C 
is 

a) 6 square units n 

b) 7 square units I 

c) 15 square units -- • 

- • • 

d) you can not tell I 










12. If n is a counting number, how is ~ 

n 

1 „ 



related to 



n + 1 ' 
1 



a) — > 

n n + 1 



b) 

c) 



n + 1 

L_ 

n + I 



n 

1 

n 



• • • • 

-I — r— I — r- 



d) you cannot tell until you know what n 
is. 

’ick'k'^dcHeie'kirk 





Inches of 




Rain 


City A 


12.7 


City B, 


100.0 


City C 


2.35 


City D 


5.1 



13 • The chart above shows the amount of rain 
for 4 cities. Which city had the least 
amount of rain? 

a) City A 

b) City H 

c) City C 

d) City D 



GO TO NEXT PAGE 




O 

ERIC 



Work the remaining problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided* 



100 



14. l| + 2| 



= ? 




15. 708 X 397 = ? 



16. 



+ 3 = ? 



T — I — r — I — 

Ti Ti. 



17. 0.483 -5- 0.21 = ? 



18. Jane made a cake. The recipe called 
2 

for cup of sugar for each cup of 
flour* If she used 6 cups of sugar, 
how many cups of flour should she use? 



1 0 0 






50 -- 



—T 1 1 T“ 

Ti T., 



T t .▼ n 



Ti T.. 



I I I I 

Ti •f^ 



19. There are 25 children in Mrs. 

Strangman's class, but on Monday 
only 20 were present. What percent 
were present? 










▼ 

T — r 



-* — 



er|c 



20 . 



Judy had ten dollars and she bought a 
sweater for $4.15. How much money 
does she have left? 






I’ArrKRNS IN ARrniMKTlC 
Orade 6 



Name 



Did you use TV arithmetic 
in grade 5? Yea 



No 



Circle your choice 



ANSWER SHEET 



1 • a b c cl 



8* a b c d 



2. a b c d • 



9. a b c d 



3 . a b c d 



10. a b c d e 



4 . a b c d c 



11. abed 



5 . a li c d 



12. a b c . d 



6 . a b i; d 



13. a 



7. a b c d 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16. 



20 . 



17. 



U2 
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I'ATIT.RNS IN ARl-niHKTTC 
Grade 6 
6 



TEST 6 

QUESTION SHEETS 



Instructions ; 



You iiitiy write anywhere on tiic question slieets. Questions 1-13 are multiple 
choice. You sliould decide whicli choice is correct and circle your choice 
on tlie answer slieet provided. 

You should have enough time to work on every question. Do not spend too 
much time on any problem. 



1. Winch number below is two hundred ten 
thousand, eighty-six? 

1 OO^'. 



a) 


210,086 


b) 


21,086 


c) 


210,860 


d) 


2,001,086 



50 -■ 



irk'k'fc'kick-k'k^'c 






“I — r 
Ti 



— T" 

Tw 



2. Which number best represents the 

probability that a person born 300 years 



4. ^ 



ago 


is still alive 


today? 


a) 


0 




b) 


0.01 


- 


c) 


_1 




300 


- 


d) 


1 


■ 



V; St "iV 



T 

“1 1 1 T 



3 . 



Five boys share three melons equally. What 
is each boy’s share? 



a) melon 

b) 

c) 

d) 



melon 

i + i 

3 3 



■z + T 



+ — melon 



+ — melon 

5 



7 

a) 

b) 

c) 

d) 



X 7" X 

_1 

12 



_7 

1 ?. 



- V 



3 

8 

1 . 

4 

I 

3 



100 ' 



50 -- 



. s 



• w 

- 1 — I — I — r 



T, 



******Vf*** 



T 



In the figure above, the line ST is drawn 
to scale; 1 inch to 100 feet. What is 
the distance represented by ST? 



a) 


200 






b) 


175 




• • 

• • 


c) 


150 






d) 


125 






e) 


100 




▼ 
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6. Tor wlucli sentence below is N 1. 

a) N = X 3 



, . N 2 
3 = 6 



c) n = 5 



J) N = 3 -r 3 



1 — I — I — r 



V* i* f * • Cz* ^* 

Tho e;irl'h*s crust is composed of muny 
The ch.'irt below lists some of 
Lheiiu Which sLatcmer.t below is not Lrtic? 

Contents of the Marthas ilrust 



Oxygen 


^»0.67 






Si licon 


11. Tl 




• 


Aluminum 


8. n 




— 


Iron 


5.07. 


- 




Calcium 


3.67 






Sodium 


2.97 




I 1 1 1 


Others 


6 . 17 







a) There is more oxygen than anything 
else. 

b) There is less sodium than iron. 

c) Silicon and Aluminum account for 
less than 307.. 

d) There is about 9 times as mucli 
oxygen as iron. 



8. Which object below is usually a cylinder? 

a) a coke bottle 

b) a tin can 

c) an egg 

d) carton of milk 



• • • 



9. if the square below is 2 inches on a 
side, what is the area of the shaded 
triangle? 




;j) 2 square inches 

l>) square i nches 

c) I squar<i i neh 

d) square inch 



-1 — T — I — r 






10. What part of tlie large square above is 
shaded? 



a) 0.13 

») T5 

c) 13 

d) 1.3 



_3 

10 




O 

ERIC 






fWP. i'‘ V'- w i M ijijimu'j 



11. When one whole number is divided by 
another whole number, which of the 
following is always true? 

a) The divisor Is always smaller than 
the quol i enl . 

I>) The tcMiiaimler Is smaller than the 
d i V i sor. 

c) The quotient is .smaller than the 
divisor. 

d) The remainder is smaller than the 
quotient . 

e) The dividend is smaller than the 
remainder. 



12. K'luch decimal below is nearest to one 
half on the number line? 

a) 0.152 

b) 0.470 

c) 0.510 

d) 0.501 







0 50 , 




ino 



13. On the scale above, the reading indicated 
by the arrow is between 

a) 58 and 60 

b) 60 and 62 

c) 62 and 64 

d) 64 and 66 

e) 66 and 68 



CO TO NI-XT PAC;i‘ 



♦ • 

T — I — I — r 










Work the remaining problems on scratch paper or beside the problem and place 
answer on the answer sheet in the space provided. ^ 



14. 5 yd. 2 ft. 

2 yd, 2 ft . 

rn yd. 1 ft. 



15. 



3 

5 



+ 



_9 

10 



7 




T — r 
' 1 \ 



16. 



17. 



0.3 + I = ? 



39.2 100 = 





18. The sack above contains 4 BMCK 

balls and 7 RHI) ones. Tf yon pick 
a ball without looking, what is the 
probability that it will be RED? 






19. Find the average of the numbers 21, 
33, 26 and 20. 



20. A triangle n inclies on a side has a 
perimeter of 60.3 inches. What is 
the perimeter r>T a triangle n -I- 2 
Inches on a side’ 




I ,er|c 



# ♦ 



« ♦ 
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PATTERNS IN ARTTHMETFC 
Grade 6 
6 



Name 

Did you use TV arithmetic 
in grade 5? yes No 



ANSWER SHEET 



Circle your choice 



1 . a l> c d 



2. a b c d 



3 1 a b c (I 



4. a b c d 



5 . a b f d e 



6 . a b c d 



7. a b c d 



8. a b c d 



9. a I) 



10. a b c (I 



11. a I) c (I 



12. a I) c d 



1 3 , a I) c d e 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16. 



20 . 



17. 



O 

ERIC 
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l*ArrKRNS IN AKITIIMI/nC 
Cradc (t 
7 



TEST 7 

OlIKSTION SHEETS 



Instructions: 



You may write anywhere on the question sheets. Questions 1-13 are multiple 
choice. You should decide which choice is correct and circle your choice 
on the answer sheet provided. 

You should have enough time to work on every question. Do not spend too 
much time on any problem. 



1. Another name for 2083 is 

a) 20 + 83 

b) 200 +80+3 

c) 2000 + 800 + 3 

d) 2000 +80+3 

ViT A- * iV** M 



1 U 



. 1 — X — I — r" 

Ti T., 



2. Another way to write 30.3 is 

a) 303 + 10 

b) ^ 

^ 100 



c) 300 + 0.3 

d) 3 + 0.3 

•k'^ic’k^Hc'k'k'k 



3. Three of our standard units of measure are 
meter, centimeter and foot. Which units 
100 
r 



are in the ratio 
centimeter 



a) 

b) 

c) 

d) 



foot 

foot 



centimeter 

centimeter 



meter 

foot 

meter 







4. Wliat is the volume of l\m box? 



• • 



“T — r- 



a) 


12 


b) 


24 


c) 


48 


a) 


60 







_l I I I I I L. 



3 

... I 



J 1 L. 



4 

B 



5. On the number line above, which number can 
be used to name point B? 



a) 

b) 



JJ, 

4 

n. 

16 



c) 2 



11 



cO f 



1 — I — r 
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Number of Children 










\ 

f- 



6. Bill's father bought new tires. After he 
had driven 3,000 miles 25% of the tread 
was worn off. How many more miles do you 
chink he can drive before all the tread 
is gone? 

3,000 



a) 

b) 

c) 

d) 



6,000 

9,000 

12,000 



50 -- 






Ti 



“T” 

T*» 



Use the chart: below to answer the next two 
questions. 



AMeiulance of 2.S (Miilclrcn in Kifth 
Orade Class lor One Week 





9. 



A cut is inade in the 
the shaded surface, 
this shaded surface? 

a) parallelogram 

b) triangle 

c) rectangle 

d) trapezoid 



cube above to give 
What is the name of 




'k'k'k'kiK'it'kicick 



10. Wtiich sentence below is true? 



a) 


1 

3 


7 

20 


b) 


II 


9 

7 


c) 


1 


6 


12 


72 


d) 


4 


11 


11 


4 




7. On which day did the greatest number of 
children in this class attend school? 



-1— t_t_t — 



8 . 



a) Monday’ 

b) Tuesday 

c) Wednesday 

d) Friday 



********** 




T I r 



If the average attendance for the week was 
20 pupils per day, by how many pupils was 
the attendance for Thursday below the 
average? 



a) 0 

b) 1 

c) 2 

d) 3 





11. In the figure above point A is joined to 
point B with a curve. What is the 
probability the curve crosses the circle? 

a) 1 

b) 100 

c) less than one 

d) greater than one 



o 

ERIC 
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a) I 

b) 1 and II 

c) II and III 

d) T and ITT 

********** 



13. If S = (3 X T) + 5, whaL is S when T = 8? 

a) 29 

b) 24 

c) 5 

d) 1 



********** 



GO TO NEXT PAGE 




O 

ERIC 

hiaifiiifftaiTi-Taaa 
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Work the remtinlng problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided. 



14. 0.-23 + 0,85 - ? 




16. 73 X 48 - ? 




100 






so -- 



—I — I — T — r- 
Ti '1\ 





( I X li ) 



7 



18. 1088 + (38 X 1.1) = ? 



Work problem 19 on the back of your answer 
sheet. Leave your answer there. 

19. 3879 -5- 27 = ? 




B 





20. For the above triangle, what is the 
measure of the angle at B. 



; 




’MiifritniW - 
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PATTERNS IN ARITHMETIC 
Grade 6 
7 



Name 

Did you use TV arithmetic 
in grade 5? yes No 



ANSWER SHEET 



Circle your choice 



1. a b c d 



8. a b c d 



2. a 



bed 



9. a b c d 



3. a b c d 



10. a b c d 



A • a b c d 



11. a b c d 



5. a b c d 

6. a b c d 

7. a b c d 



12. a b c d 

13 . a b c d 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15 



19. Answer on back of this sheet 
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PATTERNS IN ARITHMETIC 
Grade 6 
8 



TEST 8 

QUESTION SHEETS 



Instructions: 



You may write anywhere on the question sheets. Questions 1-13 are multiple 
choice. You should decide which choice is correct and circle your choice 
Oil the answer sheet provided. 



You should have enough time to work on every question. Do not spend too 
much time on any problem. 



1. The sentence 3 x N = 12 is true 
when N = ? 



a) 

b) 

c) 



2 

4 

9 



0 



;0 -■ 



d) 36 






• • • 



T .^. -r 



Ti 



T^ 



Use the chart below to answer the next 
two questions 

Contents of the Air (Percent) 

Nitrogen 



Oxygen 

Argon 

Carbon Dioxide 



"W 45 65 35 " 

Percent 



• • 

-• « 



2* About what percent of the air is oxygen? 

a) 2 

b) 20 

c) 80 

d) 19 

e) 40 






3. The ratio of nitrogen to oxygen is about 

a) 60 to 20 

b) 1 to 4 

c) 4 to 1 

d) 20 to 80 

********** 



n — I — I — r 



4. 2 out ol 5 is how many out of 100? 

a) 2 



b) 40 

c) 20 

d) 25 

e) 30 



• • 



-I.-* -1 ■ i 

ycycTcyrKycycycrTK 



5. 



3i- 



a) 

b) 

c) 

d) 



3 

2 



5 

2 



6 

2 



• • 



■r^ 1 r 



********** 



31 

9 I 284 
27 
14 

9 

5 






1 — I — 1 — r 



b. In the division problem above the 
quotient is 

a) 31 

b) 9 

c) 284 
5 



d) 



********** 
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7 . 1 I quarts Is what fraction of a gallon? 



a) I 



b) 2 



c) 2 

d) I 



10 



oX 



so -- 



— T — I — I — r- 

Ti. I4 



^irfrkirkickic'k 




g A marble is dropped into the tube at P and 
comes out at M or N. How many different 
paths can the ball travel? 

a) 1 

b) 2 



10. What is the area of a rectangle 8 feet 



c) 3 

d) 4 






-T — I — ! — r 



Suppose we decided to write fractions in 
a different way. For example, instead^of 

we would write (2,3) and instead of "j 

we would write (7,5). What would be the 
sum of (1,5) and (3,5)? 

4 

(4,5) 



a) 

b) 

c) 

d) 

«) 



14 

(3,10) 

(3,25) 



n — r 






long and 3 


feet wide? 




11 


sq. 


ft. 


b) 


22 


sq. 


ft. 


c) 


12 


sq. 


ft. 


d) 


24 


sq. 


ft. 



T T 



*AfA:AfArArAfArArAf 



11. Water and sugar arc mixed in the ratio; 
3 parts water to 1 part sugar* What 
percent of the mixture is water? 



a) 

b) 



1 

3 



c) 60 

d) 75 

e) can*t tell 



A • 

T — I — \ — r 



★ArAfAf AAA ’ A AfAr 




12. Another way to name angle DEC is 



a) angle 1 

b) angle 2 

c) angle 3 

d) angle 4 






* *AAAAA** * 



13. All but one number below is greater than 
100. Which choice is jaat greater than 100 

a) 20 X 6 

b) 21.63 

c) 100 + 0.5 

d) 100.1 

********** 

GO TO NEXT PAGE 



-r — I — r 



O 
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o 
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Work the remaining problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided. 



100 



14. 0.3 + -| = ? 



1 1 

15. 3 - X 2 -| = ? 




lOO^n 



+ I = I 



50 - 




17. 6.624 + 16 = ? 



18. 300 X 800 - ? 




19. Charles wanted to make a dog house of 
wood. He would need 10 square feet 
for the bottom, 20 square feet for the 
sides, and 12 square feet for the 
roof. Wood cost 25 cents a square 
foot. How much would the wood for 
■his dog house cost? 



20. A bicycle originally cost $47. It is 
on sale at 207. ofr the original price. 
What is the sale price? 



-t- 4 - ^i - ■- 



T I 






T 1 1 T 



• • • ▼ 

T 1 T-n- 
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PATTERNS IN ARITHMETIC 
Grade 6 
8 



Circle your choice 



1. a b c d 

2. a b c d 

3. a b c d 

4. a b c d 

5. a b c d 

6. a b c d 



e 



e 



Name 

Did you use TV arithmetic 
in grade b? Yes 



ANSWEI^ SHEET 



8» a b c d 

9. a b c d e 

10. a l> <; d 

11. a b f d e 

12. a b c d 

13. a b c d 



No 



7. a b c 



d 



Place your answers for problems 14-20 in the blanks below. 







PATTERNS IN ARITHMETIC 
Grade 6 
9 



TEST 9 

QUESTION SHEETS 



iMtructiona: You may write anywhere on the question sheets. Questions i-13 are nmltiple 

choice. You should decide which choice is correct and circle your choice 
on the answer sheet provided. 

You should have enough tin»e to work on every question. Do not spend too 
such time on any problem. 




1 . 



The 

a) 

b) 

c) 

4) 

e) 



above figure is a 

circle 

rectangle 

square 

triangle 

parallelogram 




2 . 



Which choice below is equal 




c) 7 + i 

d) l| 




ArAn A ' A ’ A 'Ar AAA A ~ 



3. If the scale length of 4 inches 

represents an actual distance of 
72 miles, how many miles does the 
scale length of 7 inches represent? 

a) 2 

b) 56 

c) 74 I 

d) 112 

e) 504 

-t m m 

A H A K Jl KinVIKX 




4. Which number is the greatest? 



a) 0.03 

b) 0.29 

c) 0.293 

d) 0.2093 




O 

ERIC 
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5. In the above prism, the back face is 
named by 

a) BCF 100^ 

■ • • • • 

b) ABFE ; 

c) GDEF 50 ” 

d) ADE 

i _i _t ■ _ y 

Ti T4 

6. Which is the least common denominator for 



1 1 <> 

6 8^ 

a) 6 

b) 8 

c) 14 

d) 24 

e) 48 




8. In a football game the Red Team was 
penalized 15 yards and on the next 
play passed for a gain of II yards. 
!<niich sentence tells what happened to 
the Red Team on the two plays? 



a) 15 + 11 = n 

b) 15 - 11 = n 

c) -15 f 11 = n 

d) 11 - 15 = n 



* **** * **** 



T 



9. 3 is what percent of 6? 

a) 0.5 

b) 2 

c) 3 

d) 50 

e) 200 

* * ****** * * 



10. Jane is going to make cookies. She rolls 
out the dough and starts to cut out the 
cookies. Jane has 3 shapes of cookie 
cutters - a circle , a square , and a 
star . If each cutter has the same area , 
which cookie cutter would probably give 
the most cookies after the dough is rolled 
out once? 



a) 


the 


circle 






b) 


the 


square 






c) 


the 


star 




* < ■ 


d) 


all 


the same 










7. 



Which of the above figures has more than 
6 lines of symmetry? 



a) I 

b) II 

c) III 

d) IV 




O 

ERIC 
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M N 

- I ■ I ‘ I ‘ f - I •■ I* 

0 1 2 3 4 5 



ll* What Is the distance from M to N on the 



number line? 




a) 2 
0, l| 


100^ 


c) 3 


50 -- 


d) 3| 


- 



********** 1' 1 T 4 



13, What is the area of a square inch on t 
side? 

a) ~ square inch I 

b) 1 square inch -- ^ 

c) square inch I , * 

-* — I — r-*T — I — 

d) 4 square inches 

A « o n A IrCKn r% 



CO TO NEXT PAGE 




.12, If E = number of EDGES 
F = number of FACES 
>.. V = VOLUME 

What is (E,F,V) for the cube above? 

. a) (9,4,3) '■ 

b) (12,6,1) ; 

c) (9,6,1) • 

d) (12,4,3) ; 

*fck'k'kic'k'Mc*k*fc 

— J — I — I — r 






er|c 







1 




_ 
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Work the remaining problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided. 



14. 0.6 X 30 = ? 



15. 



4 



5 = 



9 






16. 19 X 2010 = ? 



17 ^ ^ 

36 ^ 36 



-i — I — I — I — 

18. Oranges cost 79^ a dozen. To the 
nearest penny, how much would one 
orange cost? 



19. If the ratio of J.s 

pounds 1 

then 3 pounds is how many grams? 



20. A mouse ha^ two walls to go through 
and ‘Several holes. If he starts at 
point A, how many routes can he take 
to get to point B? The dotted line 
shows one possible way. 



100 



50 









IJ sjfn ^uw,. W'JL^ J<UJJ u ULUjM'i 
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PATTERNS IN ARITHMETIC 
Grade 6 
9 



Name 

Did you use TV arithmetic 
in grade 5? Yes Wo 



ANSWER SHEET 



Circle your choice 



1. a 



b 



c 



d e 



8. a b c d 



2 . a b c d 



9. a b c d e 



a 



b c d e 



10. a b c d 



4. a b c d 



1 1 . a b c d 



5 . 'a b c d 



12. a b c d 



6. a b c 



d e 



13. a b c d 



7. a b c d 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 



15. 



19. 



16. 



20 . 



17. 



L 

: 



o 

ERIC 

hiaifiiifftaiTi-Taaa 
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PATTERNS IN ARITHMETIC 
Grade 6 
10 



TEST 10 

QUESTION SHEETS 



Instructionc: You may write anywhere on the question sheets. Questions 1-13 are multiple 

choice. You should decide which choice is correct and circle your choice 
on the answer sheet provided. 

You should have enough time to work on every question. Do not spend too 
much time on any problem. 








163 



? 







6. Which fraction is fl£t equal to the other 
four? 



a) 

b) 

c) 

d) 

e) 



JL 

2 

__9 

27 

\ 

3 

_7 

21 

__8 

24 



ioo3^ 







T 



Ti Tv 



j,_i -« -« » ■ ■ ■ 



7. An odometer registers the distance 

traveled by an automobile. If a car's 
odometer registered 7910 miles at the 
beginning of a trip, what should it 
register after the car was driven 3 
-hours at the average speed of 30 'miles 
per hour? 



a) 90 

b) 7920 

c) 7943 

d) 7940 

e) 8000 




• • 



T — r 



T 



8. Which unit of linear measure is the most 
precise? 

a) centimeter 

b) inch 

c) foot 4 • 

d) yard 



• • 



T — r 






9. If a school is composed of 50 freshmen, 
40 sophomores, 60 juniors and 30 
seniors, then 

number of juniors _ 
number of students “ 






T — r 




-*—*--* -•--*-* ■ 



10. The picture below represents a lady bug 

about 4 times actual size. About how long 
is a lady bug? 



1 inch 1 cm 




d) 2 centimeters 










T 



o 

ERIC 

SMiifaifftiiriaaiJ 



m=i 




11 ♦ The sphere above is cut to give the shaded 
surface. What is the name of this shaded 

surface? - 

a) ellipse I 

b) circle 

c) polygon I 

- • • • • 

d) egg shaped — i — i — i — i — 




For which choice below does the dotted 
line represent a line of symmetry? 





GO TO NEXT PAGE 



12. What percent of the above figure is shaded? 



a) 36 

b) 0.36 

c) 64 

d) 0.64 




O 

ERIC 
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Work the remeining problems on scratch paper or beside the problem and place your- 
answer on the answer sheet in the space provided. 



14, — - — = ’ 
* 15 15 



100%n 



50 -- 




15. 8 ? 



16. 



2.54 



V 

10 



-r-r-I,- 



17. 2186.73 ^ 801 = ? 



18. Write j as a decimal. 




, 100%1 



50 -- 



• *_ 



~1 1 1 * I 

Tl -l\ 



• * * w 

“I 1 |—*T- 



19. How many square yards of carpet are 
needed to fully cover the floor of a 
room 12 feet by 15 feet ? 




q 

20. The sentence F=(j x C) +32 

shows how F is related to C. 

Tf C = 30, what is F? 






f 



PATTERNS IN ARITHMETIC 
Grade 6 
10 



Name 



Did you use TV arithmetic 
in grade 5? Yes No 

ANSWER SHEET 



Circle your choice 



1. a 



bed 



8. a b c d 



2. a b c d 



9. a 



b c d e 



3. a b c d 



10. abed 



4. a b c d 



1 1 . a b c d 



5 . a b c d 



12. .1 b c <i 



6. a 



b c d e 



13. 



a 



I) c d 



7. a 



b c d e 



Place your answers lor problems 14-20 in the blanks below. 

I 



14. 



I 

u 

r 



15. 



19. 



16. 



20 . 



17. 



E 










V 
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PATTERNS IN ARITHMETIC 
Grade 6 
11 



TEST 11 

QUESTION SHEETS 



Instructions: 



You may write anywhere on the question sheets. Questions 1-13 are multiple 
choice. You should decide which choice is correct arid circle your choice 
on the answer sheet provided. 

You should have enough time to work on every question. Do not spend too 
much time on any problem. 



A book has 123 pages and Nancy has read 83. 


4. i" 


Which sentence shows how many more pages 


2 


are left to be read? 




A U 

-III 


a) P = 123 + 83 


• . • • 


j 


b) P = 123 - 83 : 






50 - 




In the figure above. 


c) P » 123 + 83 




length of AB 


d) P = 123 X 83 ^ 


1 1 1 1 


length of CD 



■D 



= (?) 



Ti 



T., 



2. If 2 X n 
a) 



9, what is n? 



b) 



2 

9 

9 

2 



c) 11 

d) 18 



“I — r*T — r 



• • a _a « > ■ 



3. The bank received 57. interest on a loan of 
$300.00 for 1 year. How much interest was 



received? 


a) 


$5.00 


b) 


$6.00 


c) 


$1.50. 


d) 


$15.00 



• • 



1 — I — rr 



1 

.) i 

c) f 

<1) f 

N 5 
e) o 



»i— i„t--i -« * 1 ,1 ■ i 

TTKTCTrKTncrrfcfc 

One way to reach 2 on the number line is 

a) 2x0 

b) -3 + 5 

c) -1 + (-1) 

d) 5 + (-2) 



-T-V-r 
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6. If ABCD is a rectangle, what is the area 
of the entire figure (the rectangle and 



8 . 



9, In the triangle below, n = ? 



the 


triangle) ? 






a) 


116 


100^ 




b) 


480 






c) 


136 


50 - 


• 


d> 


25 


- 


• • 
• 




XkXXXXXXXX 


“ 










1 T"T 1 

Ti Tw 


When a counting number is divided by 23, 
what is the greatest possible remainder? 


a) 


0 






b) 


5 ; 






c) 


22 5 




• 


d) 

e) 


23 

99 


• 


' V 

• 


I” 


1 1 1 




******‘>*** 






1000 


= 10 X 10 X 10 = 10 


3 




100 


= 10 X 10 = 10^ 






1000 


X 100 = ? ; 




• 


a) 


5 : 


. • 


• • 


b) 

c) 


6 

10^ i 




T 


d) 


10® 




1 1 1 











a) 60 
I)) 65 

c) 30 

d) 15 




^ ^ A ^ ^ ^X^CrkrCrT 



“I — I — r 



10. Which sentence shows how to find the 

length (L) of the side of a square when 
you know the perimeter (P)? 

a) L = I X P 



b) L = 4 X P 

c) L . P -i- 1 



d) L + 4 = P 



T-nV-r 



i<’fcieirfrfck'fc/c'k 



GO TO NEX'I’ PAGE 
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11. Charles is using a grid with a square 
centimeter unit to determine the inner 
and outer area of a figure. He finds 
the inner and outer area are equal. 
Which figure below could he have 
measured? 





d) 




12. Which number below is nearest to zero on 
the number line? 




13. Imagine a bag that contains 5 red 

marbles and 2 blue marbles. How many 
blue. marbles would you need to put in 
the bag if you want to draw a blue marble 
about as often as a red one? 

a) 5 

b) 3 

c) 2 

d) 7 
a) 10 




CO TO NEXT PACK 










O 
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Work the remaining problems on scratch paper or beside the problem and place your 
answer on the answer sheet in the space provided# 

1 0 0 ^ 



14. 4 X 3 -| = ? 




15. 




16. Write "two hundred one and f if tj’“ three 
thousandths" as a decimal. 



-I — r 



I 

' 1 \ 




Work problem 17 on the back of j’our 
answer sheet. Leave your answer there. 



17. 8642 + 90 = ? 



iir 




18. It is estimated that by the year 1975, 
50% of the people will be less than 
28 years old. If this is true, and 
by 1975 there are 220 million people, 
how many will be less than 28 years 



19. 



Gasoline costs 35 jg cents per gallon. 
How much will 10 gallons cost? 




20. When the temperature is 32 °F sound 
travels in air at about 1,088 feet 
per second. For each 1®F increase 
in temperature sound travels 1.1 foot 
per second faster. How fast would 
sound travel at 70°F? 
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PATTERNS IN ARITHMETIC 
Grade 6 
11 



Name .. ■. 

Did you use TV arithmetic 
in grade 5? Yes No 



ANSWER SHEET 



Circle your choice 



1 . a b c d 

2. a b c d 



8. a b c d 

9. a b c d 



3. a b c d 



10. abed 



A., a 



b c d e 



11. a b c d 



5. a b c d 



12. abed 



6. a b c 



d 



13. a b c d e 



7. a b c 



d e 



Place your answers for problems 14-20 in the blanks below. 



14. 



18. 




19. 



16. 



20 . 







17. Answer on back of this sheet 
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PATTZRNS IN ARITHMETIC 
Grade 6 
12 

TEST 12 

QI»ESTION SHEETS 



Instructions: You may write anywhere on the question sheets. Questions 1-13 are multiple 

choice. You should decide which choice is correct and circle year choice 
on the answer sheet provided. 



You should have enough time to work on every question. Do not spend too 
much time on any problem. 



1. Which fraction below is the least? 



a) 


1 

2 




2 


b) 


3 


c) 


3 


10 


d) 


1 

820 




Ti 



T4 



*** *** ' .•; A** 



3. 



Suppose you toss 5 pennies in the air and 
write down the. number of pennies that 
fall "heads-up." How many different 
numbers would it be possible to write 
down? 



a) 8 

b) 6 

c) 5 
u) 4 



« - • • 

-T — t — I — r- 



— -t-|r I I ,1 



2. The drawing below is a picture of a Euglena. 
It la drawn about 100 times its actual 
size. About how long is a Euglena? 



«) 

b) 

c) 

d) 



1 

1 

1 

1 




4. 









A 



1 

2 



IJ C 

^ \- 

3 

4 






On tho number line above, point B is half- 
way between point A and point C. Whet 
number names point B? 



a) 

b) 

c) 

d) 




1 

3 



5 

8 

2 

3 




★AA A AA AAAA 
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5. Triangle ABC i» a right triangle. What 
is its area? 



A 




side? 



a) -| sq. in. 

b) 1 sq. in. 
, 1 

c) ^ sq. in. 

d) 4 sq. in. 




* ***AAAAAA 



7. 




A cut is made through the above cube to 
give the shaded face. Which figure below 
represents another cut with a shaded face 
congruent to ABCD? 




********** 



s»- 






8 . 



15 is divisible by 3 with no remainder. 
What is the next higher counting number 
divisible by 3 with no remainder? 



a) 16 

b) 17 

c) 18 

d) 19 

e) 20 




**** * ** * ** 



O 
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Questions 9 and 10 refer to the graph below. 




9. 



Three hours after starting, car A is hot/ 
many miles ahead of car B? 



a) 

b) 

c) 

d) 

«•) 



2 

10 

15 

20 

25 



T — r 



10. How much longer does it take car B to go 
50 miles than it does for car A to go 
50 miles? 



«) 

b) 

c) 

d) 

e) 



1 hour 15 minutes 

1 hour 30 minutes 

2 hour:t 

2 hours 30 minutes 
2 hours 45 minutes 

-A A t f * * -* * ■ 



12 

urns 

17 

45 

34 

11 



1 — r 



11. After the long division above has been 
done, which sentence below can be written 
to express the result? 



a) 215 = (12 X 17) + 11 

b) 215 + 11 = 12 X 17 

c) 45 - 11 = 34 

^ 215 - 170 = 45 

tW 



■r*T — I — r 



12 . 



13. 




Imagine 3 sacks that contain marbles as 
above. 

Sack A contains 1 white and 1 red marble 

Sack B contains 3 white and 3 red marbles 

Sack C contains 1 white and 2 red marbles 

If you reach in a sack and pick a marble 

without looking, which sack would the 
probability of a red ball be the greatest. 



a) 

b) 

c) 

d) 



Sack A 
Sack B 
Sack C 
It makes no difference - 



■II — r 



Which number below is between 7 and 1! 

I ^ i 



b) f + 1 



N 5 ^ 1 

‘=>6 + 7 



d) 0.30 + 0.20 

* * • *. ■ ** A. AX kk 



T 1 1 — I 



GO TO NEXT PAGE 
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Work the renuiining problems on scratch paper or beside the problem and place your answer 
on the answer sheet in the space provided. 

1 O'X- 



14. 0.8 - 0.3 = ? 



ioo/» 



15. 627 X 388 = ? so -- 



16. 3| - 3| = 1 



T — r — I — r 






Work problem 17 on the back of 
sheet. Leave your answer there 

17. 3120 4- 500 = ? 



T-^T 1 T 



18. A car can travel 60 miles on 5 gallons 
of gas. At this rate, how many niiles 
will it travel on 1 gallon of gas? 



so -- 



~i — I — I — r- 
Tl 



' I I r 



• • • 



V 



19. A $20 tent is on sale for $19. By what 
percent has the price been reduced? 




20. One cubic foot of water weighs 62.4 

pounds. How much does a column of water 
one inch square and one foot high weigh? 
Write a sentence to show what must be 

done to get the answer. You do not have 
to find the answer. 
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PATTERNS IN ARITHMETIC 
Grade 6 
12 



Name 

Did you use TV arithmetic 
in grade 5? Yes No 



ANSWER SHEET 



Circle your choice 



1. a b c d 



2 . 



!. a b c 



4. a b c d 



5. a 



6. a b c d 



7. a 



8. a b c d e 



9. a b c d e 



10. a b c d e 



11. abed 



12. a 



13. a 



Place your answers for problems 14*-20 in the blanks below. 



14. 18. 



15. 



19. 



16. 



20 . 



17. Answer on back of this sheet 



5 



O 
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Problem 



(1,19) 



( 1 , 11 ) 

(2,19) 



(3,17) 

(3,19) 



(7,12) 



a- 



◄ B7 ► 

CHANGES IN ITEMS FOLLOWING 

« 0f*l 

Change 

At T^ the problem was 3879 *r 27 = ? with no instructions 
to work the problem on the back of the answer sheet. 
Following the instructions stated: 'Vork problem 19 

on the back of your answer sheet. Leave your answer 
there." The problem was the' same as T^: 3879 -r 27 = ? 



The words 



"least likely" 



were not underlined at T . 



At T^ the problem read: "John has a stack of 500 pieces 

of notebook paper. How much does each piece weigh if 
all 500 pieces weigh 15 pounds?" After T^ the 15 pounds 
was changed to 3 pounds. 



The ? mark was added after T 



# 

1 



At T^ a single row and column of the square grid were 
shaded and the correct answer was 19%. Many pupils put 
20% because they counted the row and column intersection 
twice. The correct answer following T^ was 96%. 



At T^ figure 1 had two parts shaded and after T^ only 
the upper- left quarter circle was shaded. This improved 
the problem considerably. 



(S>^) At T^ the problem read: "2 out of 50 is how many out of 

100?" The choices were a) 2, b) 4, c) 20, d) 25, e) 30. 
Following T^ the problem read: "2 out of 5 is how many 
out of 100?" The choices were changed to: a) 2, b) 40, 
c) 20, d) 25, e) 30. 




( 8 , 12 ) 



The same figure was used at all testing periods. How- 
ever, at the question was: "Tn the figure above, 

angle AEB is the verticle angle of which angle?" 

(10,2) The only change made was to reorder the choices. Ofig 

inally they were a) 27, b) 18, c) 6, d) 3. 

(10,5) The only change made was to reorder the choices. Orig 

inally they were a) 16, b) 28, c) 36, d) >4. 

Following T^ no new changes were made in item content, location, or 
choice of distractors. The instructions were modified slightly at 
each testing period. Familiarity with the testing prodecure could 
be assumed by T^, but yet some formality was necessary for the sake 
of uniformity. 

In summary, every attempt was made to hold both the tests and 
instructions as constant as possible so that when item profiles over 
the year are analyzed one could be confident that changes in perfor- 
mance were not affected by these potential variables. 



Technical Report No. 113 (Part III) 

THE FORMATIVE EVALUATION OF PATTERNS IN ARITHMETIC 

GRADE 6 

USING ITEM SAMPLING 

Report from the Project on 
Individually Guided Elementary Mathematics 
Phase 2: Analysis of Mathematics Instruction 

T. A. Romberg, and John G. Harvey 
Principal Investigators 



By James Braswell 



Thomas A. Romberg, Assistant Professor 
of Curriculum and Instruction and Chairman of the Examining Committee 



Wisconsin Research and Development 
Center for Cognitive Learning 
The University of Wisconsin 
Madison, Wisconsin 

March 1970 



This Technical Report is a doctoral dissertation reporting research supported by the Wisconsin 
Research and Development Center for Cognitive Learning. Since it has been approved by a Uni- 
versity Examining Committee, it has not been reviewed by the Center. It is published by the 
Center as a record of some of the Center’s activities and as a service to the student. The bound 
original is in The University of Wisconsin Memorial Library. 

The research reported herein was performed pursuant to a contract with the United States Office 
or Education, Department of Health, Education and Welfare, under the provisions of the Coopera- 
tive Research Program. The opinions expressed in this publication do not necessarily reflect 
the position or policy of the Office of Education and no official endorsement by the Office of 
Education should W inferred. 



Center No. C-03 / Contract OE 5-10-154 



NA110NAL EVALUATION COMMITTEE 



Samuoi Brownoll 

Professor cf Urban Education 
Graduate School 
Yole University 


Henry Chauncey 

President 

Educational Testing Service 


Elizabeth Koonfz 

Wage artd Labor Standards 
Administration. U.S. 
Department of Lab^. 
Washington 


Patrick $upp4s 

Professor 

Department of Mathematics 
Stanford University 


Launor -F. Cartor 

Senior Vico Proiidenf on 
Technology and Development 
System Development Corporation 


Martin Deutsch 

Director. Institute for 
Developmental Studies 
New York Medical College 


Roderick MePhee 

President 

Punahou School. Honolulu 


*Benton J. Underwood 

Professor 

Department of Psychology 
Northwestern University 


Francis S. Chas* 

Professor 

Department of Education 
University of Chicago 


Jack Ediing 

Director. Teaching Research 
Division 

Oregon State System of Higher 
Education 


G. Wesley Sowards 

Director. Elementary Education 
Florida State University 


/ 


RESEMCH AND DEVELOPMENT CENTER POUCY REVIEW BOARD 


• 


Leonard Berkowitz 

Chairman 

Departnr)ent of Psychology 


Russell J. Hosier 

Professor. Curriculum ^ 

and Instruction 


Stephen C. Kleene 

Dean. College of 
Letters and Science 


B. Robert Tabachnick 

Chairman. Departmmt 
of Curriculum and 
Imtruction 


Archie A. Buchmiller 

Deputy State Superintendent 
Department of l^bWc Instruction 


Clauston Jenkins 

Assistant Director 
Coordlnoting Committee for 
Higher Education 


Donald J. McCarty 

Dean ' 

School of Educotion 


Henry C. Weinlick 

Executive Secrotary 
Wisconsin Education Aslociotion 


Robert E. Grinder 

Chairman 

Department of Educationol 
Psychology 


Herbert J. Klausmeier 

Director. RAD Center 
Professor of EducatiorKil 
P»ychol^y . i 


Ira Sharkansky 

Aisociote Professor of Political 
Science 


M. Crawford Young 

Associate Dean 
The Graduate School 


EXECUTIVE COf. MinEE 


• 


. 


• ■ » 


Edgar F. Borgatta 

Brittingham Professor of 
Sociology 


Robert E. Davidson 

Assistant Professor. 
Educational Psychology 


Russell J. Hosier 

Professor of Curriculum and 
Instruction ond of Business 


Woyne Otto 

Professor of Curriculum arid 
Instruction (Readirrg) 


Anne E. Buchanan 

Proiect Specialist 
RAD Center 

Robin S. Chapman 

Research Associate 
RAD Center 


Frank H. Farley 

Associate Professor. 
Educat’rHial Psychology 


^Herbert J. Klausmeier 

Director. RAD Center 
Professor of Educational 
. Psychology 


Robert G. Petzold 

Associate Deon of the School 
of EducoHon 

Professor of CurrIcuKtm and 
Instruction and of Music 


FACULTY OF PRINCIPAL INVESTIGATORS 




- 


Vernon L. Allen 

Professor of Psychology 


Frank H. Farley 

Associate Professor of Educational 
Psychology ^ 


James Moser 

Assistant Professor of Mathematics 
Education; Visiting Schotor 


Richard L. Venezky 

Assistant Professor of EngKsh 
and of Computer Sciences 


Ted Czajkowski 

Assistant Professor of .Curriculum 
and Instruction 


Lester $. Golub ■ 

Lecturer in Curriculum and 
Instruction and in English 


Wayne Otto 

Professor of Curriculum and 
Instruction (Reading) 


Alan Voeiker 

Assistant Professor of Curriculum 
OifKl Instruction 


Robert E. Davidson 

Assistant Professor of 
Educational Psychology 


John G. Harvey 

Associate Professor of 

Mathematia and of CurricJlum 
and Instruction 


Milton 0. Pella 

Professor of Curriculum and 
Instruction (Science) 


Larry Wilder 

Assistant Profeuor of Curriculum 
and Instruction 


Gary A, Davis 

Associate Professor of 
Educational Psychology 


Herbert J. Klausmeier 

Director. R A D Center 
Profeuor of Educational 
Psychology 


Thomas A. Romberg 

Associate Dlredor. RAD Center 
Professor of Mathematics and of 
Curriculum and Instruction 


Peter Wolff 

Auistant ProfMSor of Educational 
Piy(d)clogy 


M. Vere DeVault 

Professor of Curriculum and 
Instruction (Mathematics) 


Donald Lange 

Auistant Professor of Curriculum 
and Instruction 


B. Robert Tcbachnick 

Chairman. Department 
of Curriculum and 
Instruction 





MANAGEMENT COUNCIL 



Horbert J. Klausm«i*r Thomas A. Romborg 

Director. R ^ D Center Atsociote Director 

V*A.C. Henmon Proftsior of 
Educational PiycholoQy 



Jamos Waltor 

Director 

Dit^mination Program 



Dan G. Woolport 

Director 

Operation! and ButinoM 



Mary R. Quilling 

Director 

Technical Development Program * CX>MMtniB CHAtiMAN 



) 



ii 






APPENDIX C 



RESULTS OF THE TESTING FOR T,-T,AND 

2 4 

SUMMARY BY CONTENT AREA* 



* The tables included in Appendix C are explained in Chapter VI, 
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(U 




d 
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d 


M 


o 


CO 






4J 




4J 






u 


n 


d 


CO 


Pu 
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o 


• 


• 
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(d 


(d 


o 


II 


•H 
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Cd 


CO 


M 






d 


colO 


ON 






0) 


o 




M 




4J 


d 




0) 




• 


•H 


1 • 




iH 


CO 


M 


CO 




> 


o 




iH 


'd 


4-» 




B 






• 




(d 


00 




iH 




iH 


'd 




d 


d 






CO 


0) 


CO 








u 




o 




S 


'd 


Cd 


H 




o 


• 


o 






|H|CM 


CO 


(d 


0k 


4J 


0k 


cd 


cd 








o 


o 


d 


•• 




(d 




B 




0 






o 






o 


VO 


0) 






CM 




4J 


o 


to 


O 


M 




iH 


CO 








u 


CO 


CO 










Cd 




d 


to 


cn- 


d 




VO 


U 


d 


u 


d 


0) 




(U 


Mf 


> 


Mf 


o 


4J 




o 




00 


0) 


0) 


0) 


o 


N 


cd 


N 


m 




m 


4-1 


•H 


‘d 


•H 




iH 


u 


CO 




iH 


•H 


'd 


•H 


• 


u 


• 




O 


cd 


4-» 






0) 




•H 


iH 


d 




d 


C>4 


(U 


CM 






rd 


(d 




4J 


a 


o 


rH 


(d 


00 




00 








d 






o 






•H 


•H 




00 


o 


o 


o 


H 


4J 


N 


4J 


O 




•H 




00 


M 


U 






o 


•H 


o 




o 




•H 


•iH 


'd 


iH 




•H 


0) 


(d 


4-1 


0) 


n 


(U 




d 




M 




d 






h-3 




Pi 


H 


pc; 


5 




iH 


<3 


iH 


d: 


12 




Cl 
































< 
































































U 
































O 


d 




/-N 


/-N 








/-N 


/-N 




/-N 


/-N 


/-N 




/-N 


U 


o 


/-N 


CO 




/-N 


/-N 


o 


o 


00 


CO 




o 


CO 


o 


CO 


•H 


VO 


iH 


iH 


CO 


Mf 


iH 


iH 


H 


iH 


iH 


CM 


iH 


CM 




4J 






























• 


vg 

O 


iH 


iH 


iH 


CM 


CM 


CM 


CO 


CO 


Mf 


Mf 


Mf 


m 


m 


p 


O 
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2 




Ov 


00 


m 


rH 


CM 


<4- 




cn 








VO 


00 


00 


m 






rH 


tn 






•4- 
























H 






ov 


m 




OV 


CTi 


cn 


VO 








VO 




00 


m 




cn 


CM 


m 










a 








•}c 




* 


•K 


u 








iH 






CM 




to 


00 


(T* 










vO 


vO 


ov 


CM 


rH 


rH 




CM 






CO 
























H 




OV 


CNJ 


o 


o 


rH 


rv 




<t 




CO 
1 1 










Ov 




rH 




rH 


CM 


VO 


rH 






























a 






* 






o 




•K 


(0 
























0) 




























?5 


VO 


m 


CM 




o 


o 


cn 




cn 


<N 




VO 


Ov 


rH 








rH 


rH 








H 






Ov 


VO 


O 


o 


m 


cn 




VO 








VO 




00 


CM 








cn 


CM 








•K 


M 


M 


















12; 


VO 


00 


m 


CO 


VO 


o 


cn 


CM 


O 












VO 










rH 


CM 




rH 
























H 




cn 


CM 


00 


VO 


m 


o 


CM 


CM 


cn 








CNJ 




00 










rH 


CM 







• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 


• 






• 


0 


• 


• 


• 


• 






• 


• 


• 






• 




• 


• 


• 


• 






• 

• 


• 

• 


• 

• 






• 

• 


V 


• 

• 


• 

• 


• 

• 


• 

• 






• 


• 


« 






• 


• 


• 


• 


• 


• 






• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 


• 
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• 






• 


• 


• 






• 


• 


• 




• 


• 






• 


• 


• 






• 


• 


• 




• 


• 






• 


• 


• 






• 


• 


• 


00 


• 


• 






• 


• 


• 






• 


• 


• 


• 


• 


• 






• 


• 
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• 


• 


• 


Ov 


• 
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• 


• 


• 






• 


• 


• 


CM 


• 


• 






• 


• 


• 






• 


• 


• 


rH 


• 


• 






• 


• 


• 






• 


• 


• 


rH 


• 


• 




4J 


• 




• 




4J 


• 










• 




c 


• 




• 




Pi 


• 










• 




0) 


• 


00 
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0) 




cn 


CM 






• 




4J 


• 


o 






4J 




• 


Ov 
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• 
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C 


VO 
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O 
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rH 


•H 
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rH 






4J 






II 
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•H 
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O 
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rH 


II 


II 




cd 






m 


II 






II 


CM 










M 






00 


Td 
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00 


VO 


H 


4J 
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cn 
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• 


cd 
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rH 






O 


Cd 
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o 


H* 






H* 


cn 
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1 


+ 




C 








H* 


+ 




X 






+ 
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o 




X 


cn 














cn 


•H 






00 


CM 


00 


CM 




c 




CO 


CM 


00 
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CM 
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• 


00 


VO 


VO 
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• 


• 


Cd 




• 


• 


ON 


o 
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o 
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o 
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VO 
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C 










•H 
















o 
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•H 










4J 
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rH 
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VO 




rH 


kS 


o 
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00 
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C 


•H 


rH 


rH 
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rH 


rH 


rH 


rH 


rH 


rH 










0k 




4J 
















cd 


0k 


0k 


CM 




Cd 


0k 
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0k 


0k 


* 


0k 


• 


o 


VO 




rH 


• 


o 




m 


vD 




00 
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o 






w 
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H 
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•H 
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cd 
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VO 
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CM 
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00 


CO 




CM 


m 



CM 


m 


VO 


cn 


00 


00 


CM 


in 
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m 


CM 


m 


u 


•)c 


* 




•Jc 


a 


* 




00 


00 


CA 


CO 




CO 


CM 




CO 


CM 
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CO 



o 






CM 


vO 


Ov 






rM 


m 


m 


CO 


CM 




■K 
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o 


-cj- 


o 


m 


cn 
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iH 


iH 




cn 


CM 




cn 
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iH 


iH 






00 


VO 




H 


cn 




cn 


iH 


cn 








•JC 


•Jc 




o 




00 


00 


CM 


iH 


m 




CM 




CM 


iH 


CM 











VO 


00 








O 
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CO 




CM 




cn 






iH 


iH 




CM 




o 
























• 


• 






• 


• 


• 


• 








• 


• 






• 


• 


• 


• 
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• 






• 


• 
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• 


• 






• 


• 
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• 






• 


• 


CM 


C 
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• 
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• 




•H 








• 


• 






• 




II 
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• 

• 


• 

• 








• 

• 


o 


M 








• 


• 








• 




(U 








• 


• 






II 


• 


X 


X) 








• 


• 






• 




6 








• 


• 






CO 




ON 


3 








• 


• 
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• 


C 








• 


• 






C 


c 
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0) 


•H 
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iH 


4J 
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4J 
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4J 


0) 
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• 




0) 


0) 


0) 


C 


4-» 






CM 


• 




4J 


3 


rO 


0) 


4J 


c 












C 




6 


iH 


CO 


o 












o 


4J 


3 


Cd 


(U 
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CM 




o 




C 


> 


M 






C^* 


• 






CO 




•H 


Cd 






• 




ON 






•H 


c 
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m 


II 


Vw' 
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o 


CT" 
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CM 




0) 






(U 








iH 




c 




cn 




fH 








O 


C^* 


•H 




!K! 


m 


4J 


Cd 








00 








• 


O 


e 
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lo 




n 






CO 


iH 


C 


•H 






iH 


M* 


M 




00 






O 




1 


1 




CO 


0) 








0) 


0) 




II 


CO 








It 


4-1 


CJ 


•o 










H* 


a 






•H 


C 










• 








CO 


4J 


0) 


rd 








VO 


VO 


z 




00 


C 


4J 


o 




m 


iH 


00 


• 






o 


0) 


C 


•H 




• 




iH 




« 




• 


•o 


(U 






CM 




CM 


CM 


CO 




o 


H 


CO 














0) 






















o 






















c 






















0) 




















4J 












c 


vO 




m 


C 


c 










o 


iH 


iH 


iH 


0) 


o 








CM 


•H 










CO 


•H 






ON 


iH 


4J 






0^ 


0k 




4J 










cd 


O 


o 


iH 




Cd 




0k 






a 


iH 




iH 


• 


o 


CM 


CO 


CO 


vO 


0 






w 
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o 


>w^ 
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H 






523 



cn 

H 



CO 

4J 



3 

CO 

o> 









H 














CO 

3 

O 

0> 

cd 



o> 

o 

CO 

•H 



s 



CO 



o 

0> 

Q 



•H 

0> 

VI 

a 

M 

0) 



(0 

C 

o 

•H 



Cd 

o 

•H 

iH 

a 

a 

< 

VI 

o 

VI 

CO 



Q 



VI 

C 

0) 

VI 

C 

o 

o 



c 

o 

VI 

Cd 
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o 

1-^ 





a\ 


o\ 


a\ 


VO 




CO 


00 


VO 


Mf 




v£) 








VO 


iH 


m 










-ct 


iH 




iH 


VO 




CO 


CM 


vO 




CM 


VO 


00 




Mt 


m 


iH 


Mt 






VO 


rM 


O 


a 




* 


a 


•}c 


•K 


a 


o 


o 


O 




CM 


VO 


o\ 


o 


m 


vO 


a\ 


CM 


CM 




VO 


00 




CO 


m 




iH 




m 


vO 




o\ 


CM 


VO 


iH 


VO 


m 




00 


CO 


m 


00 


m 


VO 




CM 


m 






VO 




VO 




a 




a 




a 






VI 


o 


VI 


o 




1-M 


CO 


CM 


m 




O 


iH 


CM 




CO 


m 






CO 








CO 


CM 


m 


00 




CO 


CM 


a\ 


m 


O 


CO 


CM 




CM 


m 


VO 




CM 






iH 


m 


CO 


m 


a 


•Jc 


a 


O 


o 




* 


* 




* 




iH 


00 


o 






o\ 


o 


CO 


Ml- 


CO 


CO 


<t 


CM 






CM 








CO 


iH 


CM 




m 


00 


VO 




o 


00 


VO 


o 


m 


m 






CM 






CM 


CO 


I-M 





u 



• 


• 


• 


• 


• 


• 


• 


• 


• 


o 


• 


• 


• 


• 


• 


• 


• 


• 


% 


0) 


* 


• 


• 


• 


• 


VI 


• 


• 


• 


*d 


• 


• 


• 






o 


• 


• 


• 






• 


• 


• 




c^* 


cd 


• 


• 


• 


CO 


• 


• 


• 




O 


Vl 


• 


• 


• 


cd 


• 


• 




O 


O 


VI 




• 


• 








• 


CO 


i-M 


1-M 






• 


• 




o 




• 


• 






d 


CO 


• 


• 


CO 


o 


VI 


• 


o 


+ 


c 


CO 


o\ 


• 


• 


m 


o 


CO 


• 


VO 




cd 




CM 


« 






I-M 


? 


• 




CO 




•d 


• 


o 


Vl 






VI 


• 


II 


o 


VI 


d 


o 


e 


cd 


*d 


o 


• 




CO 




cd 


N-/ 


• 


0) 


! 


a 




• 


P 


N-/ 


M 








>, 


Cd 


(0 


• 






0) 














*• 


• 


CO 


CO 


VI 


Mf 




VO 


i-M 


0) 


•C. 




cd 


• 


cd 


</y 


VI 


• 




1 


a 


VI 






o 


0) 




CO 


o 


Vl 


( 


0 


Vi 


CO 




CO 


Vl 


cvc 


0) 


N-/ 


O 






cd 


I-M 


0) 




00 


o 


VI 




C4M 


*d 




• 




0) 






cd 


i-M 




1 


a 




o 




VI 


VI 




0) 


qj 


O 


cd 




V—/ 


CO 


•H 


o 


o 


Vl 




O 






o 






H 


c 


CM 


00 




CO 


"d 




•d 


Cd 


? 








O 


</y 


0) 


CO 


0) 






CO 




CO 


0) 




1 


Li 


VI 


•d 


d 


o 


•H 




•H 


»d 


c 


*d 


c 


cd 


o 


VI 




•H 






o 


1 


a 


<D 


a:: 






0) 


> 


Vl 


cd 




i 


:2 


VI 


(0 






o 


i-M 


0) 




VI 


Si 


c 




ti 


cd 


•H 


O 




CO 


CO 






o 


VI 






O 


> 


§ 


cd 


0) 


{ 


D 


o 


Vi 


0) 




jci 


c 






Vl 


1 




— 


cd 


i-M 


Vl 


o 


•H 


d 


co|m 


0) 


J 


J 




CX 


00 


0) 










VI 






VI 




d 


02 


SI 




02 


0) 


c 


0) 


Vi 


VI 


cd 


VI 


o 


Vl 


O 


VI 


•H 


VJ 


cd 


cd 




o 


•H 


O 


•H 


•H 




•l 


H 




a:: 


Vl 


q 


Si 


VI 


02 


Vl 




1 


L| 


o 




H 






CO 


pc 











o 


o 




CO 


o 




00 

i-M 


CO 


\o 

i-M 




rM 


CM 


CM 


rM 


CM 






m, 




•% 














o 


i-M 


i-M 


vO 


VO 


VO 




00 


00 


o\ 


r-C 
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s— / 












N-/ 


N-/ 





ERIC 
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H 



cn 



CO 

4J 

3 

CO 

0) 

oti 



CNJ 



H 



2: 




ov 


cn 


VO 


CO 


CM 


C7X 




o\ 




VO 




Mt 


Mt 


CO 


CM 


00 






>* 






cn 


00 


m 


O 


VO 


O 


m 




m 


00 


Mt 


m 


CO 


CM 


00 


00 










•Jc 


u 


o 


•Jc 


U 


U 


U 


2: 


cn 


m 


OX 


o\ 


o 


CO 


CO 


rM 






m 




rM 


CO 


CM 




00 


VO 


Mt 


>* 




a\ 


44 


00 


CM 


m 


CM 




Mt 




m 




Mt 


Mt 




00 














o 


O 






•Jc 


•Jc 


2: 


00 


Ov 


rM 


m 




o 


00 


VO 


VO 




VO 




rM 


CM 


rM 




VO 


CO 


CO 


>• 


o 


CM 


Ox 


VO 


o 


rM 


CM 


Mt 


CM 




VO 




CO 


CO 


CO 




00 


CO 


CO 




a 


U 


















cn 


O 


Mt 


ox 


ox 


o 


CO 


ox 


m 


2; 






rM 


rM 


CM 




VO 


CO 


Mt 




i-H 


rM 


Mt 


m 




o 


Mt 


ox 


VO 




m 




CO 


Mt 


CO 




00 


Mt 


CO 




o 


•ic 


o 


•JC 


o 




•JC 


o 


o 



CO 

m 



o 









VO 

m 



VO 



<t 

VO 



<t 

VO 







• 

• 

• 

• 

% 




• 

• 

• 

• 

• 


• 

• 

• 

• 

• 


• 

• 

• 

• 

• 




• 

• 

• 

• 

• 


• 

• 

• 

• 
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• 

• 

• 

• 

• 


• 

• 

• 

• 

• 


• 

• 

• 

• 

• 


• 

0 

• 
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• 




• 


• 


• 




• 


CO 




• 


• 


• 






• 




• 


• 


• 




• 


•d 


c*« 


• 


• 


• 






• 




• 


• 


• 




• 


60 


O 


• 


• 


• 






• 




• 


• 


• 




• 




O 


• 


• 


• 


CO 








• 


• 


• 




• 


a) 


• 


• 


• 


• 


4J 




CO 




• 


• • • 


• 








rM 


• 


• 




•H 




(U 




• 


8 • 


• 


C 


»• 




<n- 




• 


• ^ 






rM 




• 


0) 


• 


4 


J 


0) 




• 


• 


u u 






•H 




• 


rM • 


• 




3 


o 


U 


• 


« 


cd cd 
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• 




• 


i 


0 
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o 


• 
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'd 








• 


o 


• 
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• 


• 
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VO 
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• 


cd 
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CO CO 


cd 


, 


00 




• 


o* • 


• 
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'd 
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(5,10) If two distances are equal, what is 

their ratio? c 65 52 63 58 c 71 67 c 79 68- 
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TABLE 9C. results BY CONTENT AREA; LONG DIVISION (CONTINUED) 
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Patterns in Arithinetic 
Che^upl 



Instructions : Find the 
answer to each question. 
Your teacher will tell you 
where to put your answers 





1 . Write three hundred twenty-nine thour" idths as a decimal. 



2. Add the mixed numbers 3 ~ and 1 ^ . Write your answer as a mixed 
number. 



3. What is the perimeter of rectangle ABCD? 



4. What is the area of rectangle ABCD? 



5 . What fraction of the circles are shaded ? 



6. Write ^ as a basic fraction. 






0”^0 



8 7 

7 . Write the sum + 10^ ^ decimal . 

8. Find the number that makes the sentence below true. 

2^3 

7 + 7 = m 



9. Which number below is least? 

2 

800 •* 5 



1 2 
23.6 .1 “ 1 



10 . 



o 

ERIC 



Solve the sentence 16 x g 



208. 
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11 . The picture at the right represents two 
fractions that are equal . What are these 
fractions ? 



1 

X «'« I 



Solve the sentence 




n . 



13. 



Write 



123 

1000 



as a decimal. 




14. If 5 pounds of apples cost 60jzf, how much will 3 pounds cost? 



15 . What is the volume of the box? 

16. Each side of a square is 1 ft. 3 in. 
What is the perimeter of the square? 




17. Add: 



2.61 

3.58 



18. Mr. Jones collects eggs on his chicken farm each day. One day he collected 
6213 eggs and put them into cartons with 12 eggs in each carton. How many 
cartons did he fill? How many eggs remain? 



19. The auditorium at school has 41 rows of seats with 36 seats in each row. One 
day every seat was taken but 3. Write a sentence to show how many seats 
were taken. Solve the sentence. 



20. One morning the mileage on Bill's car read 12063.8 miles. At the end of the 
day the mileage read 12317.5 m.iles. Write a sentence to represent the num- 
ber of miles traveled during the day. Solve the sentence. 
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DEVELOPMENTAL YEAR RESULTS FOR CHECK-UP 1 



Check-Up 1 was administered following Program 15. It was found 
to be weak and difficult and was modified for inclusion in the Pupil 
Exercise Manual. No summary statistics are available for the modified 
version, however, a few items were the same and the results for these 
items are summarized in Table Dl. 



TABLE ID 

RESULTS FOR SELECTED ITEMS ON CHECK-UP 1. 
114 PAPERS WERE SCORED 



Item Percent 

Number Responding Correct 



1 


57 








2 


67 








14 


49 








18 


Cartons 


74%. 


Extra Eggs 


80% 


19 


Sentence 


62%. 


Answer 


53% 


20 


Sentence 


72%. 


Answer 


11 



o 
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Instructions: Find the answer 
to each problem . Your teacher 
will tell you where to put your 
answers . 





1 . Which choice represents the 
correct way to name the angle 
above ? 

a) L FPC 

b) L FCP 

c) L CFP 

d) L PFC 

e) L PCF 



2 . 




? 



a) 






r 



b) 



c) 

d) 



IQ. 

18 

10 

77 

16 

77 

16 

18 



/ 



3 . There were 1 26 apples in a 
basket and of them were 
green . How many were green ? 

a) 34 

b) 42 

c) 84 

d) 125 I 

e) 378 




4 . What is the volume of the 
rectangular box above ? 



a) 10 cu. in. 

b) 11 cu. in. 

c) 11 in. 

d) 40 in. 

e) 40 cu. in. 



o 
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5. 



2x3x7 



2x7 



= 9 



a) 

b) 

c) 

d) 



42 

21 

14 

3 



6. Hamburger costs 69^ per pound, 



How much would j pound of 



hamburger cost? 



a) 

b) 

c) 

d) 

e) 



99(zf 

SOjzi' 

46(2^^ 

40(zT 

23(zT 



7. Solve the sentence 



-X n = 1 



a) ^ 



2 

5 



b) 

c) 2 

d) ^ 

^ 5 

e) 1 



8. 



9. 
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10 . 



What is the area of 
triangle DEF above? 

a) 48 sq. units 

b) 24 sq. units 

c) 20 sq. units 

d) 40 sq. units 

e) 19 sq. units 



Which choice below will 
be greater than 263 ? 



a) y X 263 



b) ^ X 263 
o 



1 



c) 1 j X 263 



d) 0.93 X 263 



The sum of the angles 
of a triangle is 



a) 90® 

b) 180® 

c) 270® 

d) 300® 

e) different for each 
triangle 



For the next 5 problems choose the 
word which best fits the sentence. 

11 . The is a 

standard unit of measure 
for angles . 

a) erg 

b) protractor 

c) inch 

d) centimeter 

e) degree 



12. The number of square units in 
the interior of a closed region 

is called the 

of the region . 

a) perimeter 

b) area 

c) volume 

d) altitude 

e) grid 



2 1 7 

14. The fractions — , , and 

0 V ^ X X 

— are all 

fractions . 

a) stretcher 

b) mixed 

c) basic 

d) prime 

e) odd 



15. The distance around a square 

is called the of 

the square. 

a) perimeter 

b) area 

c) volume 

d) edge 

e) face 



GO TO NEXT PAGE 



13. One figure that always has 
four congruent angles is a 



a) rectangle 

b) triangle 

c) parallelogram 

d) polygon 

e) trapezoid 



T 
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MATCH 



For each problem in List A find the answer, locate it in List B . and place it 

the blank. Use scratch paper when necessary. Answers may be used 
than once. 



in 



more 



List A 



List B 



16 . 



2.0 - 0.4 



17 . 



18 . 



19 . 



20 . 



21 . 



22 . 



_ 1.3 + 0.03 



(j X 21 ) 



2 3 

3^6 



f X 45 



- 6 



23. 



3 y X 21 



X X 

16 4 7^ 



thirty-three thousandths 



63 i 

'I 

6 

9 

S 

9 

I 

3 

33,000 

3 

36 

66 

1 

180 

2.4 

1.6 

1.33 

0.303 

0.033 



24. 



reciprocal of 3 



o 
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^otk. th6 probloms bslow ♦ Your tG^chor will toll you whoro to put your snswors • 



25 . Solve the sentence 




and write your answer 
as a basic fraction. 




26. When ABCDE is reflected through line L 



a. Which letter names the image of point D? 

b. How long is the segment OS? 

Co How many degrees are in Z2? 

d . If the distance from point C to point S is 
21 " , what is the distance from point C to 
thv? line of reflection ? 




ll" 



27. Find the area of the above parallelogram. 
Include units with your answer. 



28. Divide: 2342 h- 61 

After you have done the division complete 
the sentence below. 



29. Divide: 72031 9 

After you have done the division write 



2342 = (61 X 




as a mixed number 



72031 

9 



(mixed number) 
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DEVELOIMENTAL YEAR RESULTS FOR CHECK-UP 2 



Check-Up 2 was administered following Program 30 and 264 papers 
were scored. The mean score (based upon 100 possible points) was 64.1 
and the standard deviation was 21.7. Table D2 shows the percent re- 
sponding correctly to each item. 



TABLE 2D 

RESULTS ON CHECK-UP 2 BASED 
UPON 264 TESTS SCORED 



Item 


7o Correct 


Item 


7o Correct 


1 


88 


17 


85 


2 


98 


18 


77 


3 


80 


19 


74 


4 


75 


20 


73 


5 


74 


21 


62 


6 


69 


22 


66 


7 


80 


23 


57 


8 


33 


24 


36 


9 


70 


25 


22 


10 


36 


26 


a) 93 b) 75 


11 


44 




c) 59 d) 63 


12 


59 


27 


43 


13 


56 


28 


Division 61 


14 


84 




Sentence 64 


15 


74 


29 


Division 62 


16 


78 




Sentence 56 





Instructions; Find the ans'^^er 
to each problem . Your teacher 
will tell you where to put your 
answer. 



1 . Which choice below shows how to 
write 973jzf as dollars? 

a) $0,973 

b) $9.73 

c) $97.30 

d) $973.00 

e) $9730.00 



2. H 1 (p I 1 ► 

0 12 3 4 

Which sentence below is repre- 
sented on the number line graph 
above ? 

a) n < 2 

b) n > 2 

c) n > 2 

d) 2 > n 

e) 2 < n 




a) 36 

b) 48 

c) 9 

d) 11^ 

e) 16 



± If ^ 

<? 




4. To solve *ne sentence "tx n = 70 

sJ 

3 

a) Multiply both sides by ~ 

1 ^ 

b) Add ~ to both sides 

^ 2 

c) Subtract — from both sides 

^ 3 

d) Divide both sides by — 

1 ^ 

e) Add ~ X n to both sides 



5 . Two thirds of all light bulbs 
tested were bad. If 24. bulbs 
were bad, how many were tested? 

a) 7 2 

b) 48 

c) 36 

d) 28 

e) 16 



o 
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6. Mr. Brown had a leak in a water 
pipe and placed an empty 5 gallon 
can under the leak to catch the 
dripping water. A few hours later 
he returned to see how much water 
was in the can. Which number 
line graph shows how many gallons 
of water could be in the can? 



a) -4 ♦ ♦ ♦ ♦ 4 

0 1 2 3 4 5 



b) (pH I '< i 

0 1 2 3 4 5 



c) -4 4 4 # ♦ # 

0 1 2 3 4 5 
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Problems 9 and 10 refer to the graph 
below. 




d) H 1 1 1 1 4 

0 1 2 3 4 5 



7. 100 X 0.76 = ? 



The graph above shows the average 
yearly rainfall in inches for San 
Francisco (S) , Denver (D) , Key West 
(K) , Hartford (H) and Minneapolis (M) . 

9 . Wiiich city had the greatest 
amount of rain ? 



a) 100.76 

b) 7.6 

c) 76 

d) 760 

e) 1.76 



8. 0. 2 X 0.7 = ? 



a) San Francisco (S) 

b) Denver (D) 

c) Key West (K) 
cl) Hartford (H) 

e) Minneapolis (M) 



10. What was the average yearly 
rainfall in Key West (K) ? 



a) 140 

b) 14.0 

c) 1.4 

d) 0.14 

e) 0.014 



a) 43 inches 

b) 38 inches 

c) 33 inches 

d) 25 inches 

e) 20 inches 



11 




Fig. a Fig. b Fig. c Fig. d 

Each figure above has volume. 
For which figure could the volume 
be found by the formula: 

Volume = (area of base) x (height) 

a) Figure a 

b) Figure b 

c) Figure c 

d) Figure d 



12. The sentence n > 3 has many 

answers . Which choice below is 
not an answer? 

a) n = 0 

b) n - "l 

c) n = ■^800 

d) n = "5 

e) n = ^3 



1 3 . £f you divide — pie equally 
among four people, how much 
would each person get? 

a) - pie 

b) - pie 

c) - pie 

d) ^ pie 

e) j pie 



5 -7 = 



V 



a) 



il 

15 



il 

21 



. 15 



d) 

e) 



12 

_6 

35 
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1 5 . Which sentence below is 
equivalent ton-12<3? 

a) n = 9 

b) n < 9 

c) n = 15 

d) n < 15 

e) n < 4 





16. To find the volume of the vase 
above, it was filled with water 
and the water was then poured 
into the box. What is the volume 
of the vase? 

a) 1 2 cu . in . 

b) 14 cu. in. 

c) 24 cu. in. 

d) 36 cu. in. 

e) 60 cu. in. 



o 






17 - 21 . 



T 

2 



1 — I — I — I — r 
1 0 









I 



•T* 



•1 
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Notice how the point A = 3 has been indicated on the number 

line above . In a similar manner indicate carefully and neatly 
each of the following points: 



B = 5, C = 0, D = 1, E = 



+1 



3* 






22. Which of these numbers is the least: ^5, 0, 1, 1~ 



. Solve the sentence: 
^4 + 3 = n 


27 . A board 1 7 feet long is cut into 
3 equal pieces. How long is 
each piece? 

Sentence 


. Are all positive numbers greater 
than ? Explain your answer 

briefly . 


Answer 


28. Multiply: 4.3 

X 2 


. A scout troop made money by 
selling tickets to a circus . 

They made $1.05 on each ticket 
they sold. If they sold 83 
tickets, how much did they make? 

Sentence 


29. Multiply: 2.09 

X 1.6 


Answer 




. A cake recipe calls for 8~ 
cups of flour. If Frances 
wants to make a cake one-third 
the size of the recipe, how much 
flour should she use? 

Sentence 

Answer 


30. Solve the sentence: 

if. 6.. 



25. 



er|c 
a — 
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DEVELOPMENTAL YEAR RESULTS FOR CHECK-UP 3 



Check-Up 3 was administered following Program 44 and 166 papers 
were scored. The mean score (based upon 100 possible points) was 68.4 
and the standard deviation was 18.4. Table D3 shows the percent re- 
sponding correctly to each item. 



TABLE 3D 

RESULTS ON CHECK-UP 3 BASED 



Item 


UPON 166 TESTS 
% Correct 


SCORED 

Item 


% Correct 


1 


83 


18 


88 


2 


56 


19 


92 


3 


54 


20 


54 


4 


64 


21 


69 


5 


55 


22 


82 


6 


68 


23 


90 


7 


49 


24 


51 


8 


75 


25 


Sentence 93 


9 


99 




Answer 69 ^ 


10 


89 


26 


Sentence ^ 


11 


38 




Answer ^ 
Sentence 88 


12 


75 


27 


13 


70 




Answer 73 


14 


59 


28 


92 


15 


35 


29 


65 


16 


63 


30 


49 


17 


92 
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Rattems in Arithmetic 
Ch^k-up 4 



Instructions: Find the answer 
to each problem . Your teacher 
will tell you where to put your 
answers . 



E 








1, Triangles ABC and DEF are similar. 
Which angle in triangle ABC corre- 
sponds to angle F? 

a) angle A 

b) angle B 

c) angle C 

d) angle D 

e) angle E 



2. Which number below is the greatest? 

a) 3.63 

b) 3.08 

c) 3.067 

d) 3.627 



3. Which choice gives the same answer 
as .3 1 1.67 ? 

a) 3 I 1.67 

b) 3 I 16.7 

c) 3 I .167 

d) 3 I 167. 



4. 11.3 X 100 = ? 

a) .1130 

b) 1.130 

c) 113.0 

d) 1130. 

e) 11.300 



5 



Xi 



5. One day an ice cream shop sold 
80 ice cream cones. 35% of the 
cones sold were chocolate. How 
many chocolate cones were sold? 



a) 27 

b) 28 

c) 35 

d) 45 

e) 5 2 





Fig. A 



Fig. B 



6. Is Figure A similar to Figure B? 

a) Yes, because both are 
parallelograms . 

b) No, because corresponding 
angles are not equal. 

c) Yes, because each figure 
has four sides. 

d) No, only triangles can be 
similar. 



7. Which number is between 12.6 
and 12.7? 

a) 12.061 

b) 12.073 

c) 12.691 

d) 12.065 

e) 12.600 
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8. Solve the sentence' 
k • I' J (.6 X 

a) 9.2 

b) 5.42 

c) 4.2 

d) 10.0 

e) 39.2 



9 . What value of n makes the sentence 
2.67 X n = 267 true? 

a) .01 

b) .10 

c) 10 

d) 100 

e) 1000 



10. A bag contains 21 pieces of candy: 

13 green and 8 yellow. If you pick 
a piece from the bag without looking, 
what is the probability that it will 
be green ? 



a) 13 
13 
8 

_3 
13 



b) 

c) 



d) ^ 
21 

, 13 

2l 
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11. Which sentence is equivalent to 
142 - n = 30? 

a) n = 142 + 30 

b) n = 142 - 30 

c) 142 = 30 - n 

d) 30 = n - 142 



12. During a basketball game a 
player shot 25 times and made 
8 shots. What per cent of the' 
shots did he make? 

a) 8 

b) 25 

c) 32 

d) 33 

e) 68 





13. The two triangles above are 
similar. How long is the side 
labeled n? 

a) 10 

b) 9 

c) 6 

d) 4 



14. How do you write .263 using 
per cent ? 

a) . 263% 

b) 2.63% 

c) 26.3% 

d) 263% 




15 . A doctor kept a record of how 
many shots he gave; 



Monday 


18 


Tuesday 


16 


Wednesdc 


26 


Thursday 


16 


Friday 


24 



On the average how many shots 
did he give each day? 

a) 16 

b) 17 

c) 18 

d) 20 




234 




25. A $20 tent is on sale for $18. 
By what per cent has the price 
of the tent been reduced ? 



27. Divide: 5.922 ^.47 = ? 
Answer 



28. If 3^ = 729, then 3^ = ? 



Answer 



Answer 



26. What is 15% of 70? 



Answer 






3 ft. post 



29. A post 2 ft. high casts a shadow 9 ft. long. 
How long would the shadow of a 3 ft. post be? 

Answer 




Work out the answer for these problems . 



16. Divide: 61.5-f-3 = ? 



22. Solve the ratio sentence: 



8 

2.4 



10 

n 



Answer 



17. A box of cereal weighs 4 

How much will 10 boxes weigh? 

Sentence 

Answer 



18. Write a decimal between 6.23 
and 6.24. 

Answer 



7 

19 . If the probability of rain is 

what is the probability that it 
will not rain ? 

Answer 



20. Divide: 0. 6-^0. 3 = ? 
Answer 



21. Susan took a spelling test of 
100 words. She spelled 81 words 
correctly. What per cent did 
she spell correctly? 

Answer 



Answer 




23. There were 25 sixth graders in 
Mr. Green's class. They were 
collecting insects . After 5 weeks 
175 insevcts had been caught. What 
was the average number of insects 
caught by each person ? 

Answer 




24. Experiment: Flip the spinner.. 
What is the probability that the 
spinner will stop on a region 
with a #|c on it ? 

Answer 



o 
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